00000100:00100000:3.0F:1788652098.529135:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652098.529173:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147681920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652098.529266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0F:1788652098.529556:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147682432:0@lo:400:kworker.0 00000100:00100000:1.0:1788652098.529614:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652098.531129:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147682048:0@lo:400:kworker.0 00000100:00100000:3.0:1788652098.531199:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652098.532174:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147682560:0@lo:400:kworker.0 00000100:00100000:3.0:1788652098.532309:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652098.532354:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147681920 00000100:00100000:3.0:1788652098.532361:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147681920 00000100:00100000:3.0:1788652098.532422:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788652098.532432:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147681920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788652098.532456:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788652098.532503:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147681920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (3237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652098.532510:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788652098.532532:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147682048 00000100:00100000:3.0:1788652098.532536:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147682048 00000100:00100000:3.0:1788652098.532559:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788652098.532564:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3636:x1875537147682048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652098.532743:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147682944:0@lo:400:kworker.0 00000100:00100000:3.0:1788652098.534032:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3636:x1875537147682048:12345-0@lo:400:kworker.0 Request processed in 1459us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652098.534047:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788652098.534115:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147682560 00000100:00100000:3.0:1788652098.534123:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147682560 00000100:00100000:3.0:1788652098.534170:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788652098.534190:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147682560:12345-0@lo:400:kworker.0 00000100:00100000:2.0F:1788652098.538335:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147682176:0@lo:400:kworker.0 00000100:00100000:1.0:1788652098.541305:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652098.541376:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147683456:0@lo:400:kworker.0 00000100:00100000:1.0:1788652098.541438:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652098.541470:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652098.541478:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147683584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652098.541506:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652098.541556:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147682432 00000100:00100000:1.0:1788652098.541565:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147682432 00000100:00100000:1.0:1788652098.541629:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147682944 00000100:00100000:1.0:1788652098.541632:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147682944 00000100:00100000:1.0:1788652098.541649:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147683456 00000100:00100000:1.0:1788652098.541652:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147683456 00000100:00100000:1.0:1788652098.541672:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788652098.541680:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147682432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652098.541738:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147682432:12345-0@lo:400:kworker.0 Request processed in 58us (12123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652098.541745:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788652098.541762:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788652098.541769:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147682944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652098.541811:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147682944:12345-0@lo:400:kworker.0 Request processed in 42us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652098.541817:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788652098.541830:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788652098.541836:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147683456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652098.541882:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147683456:12345-0@lo:400:kworker.0 Request processed in 47us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652098.541889:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788652098.541958:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147682432:0@lo:400:kworker.0 00000100:00100000:1.0:1788652098.541968:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147682944:0@lo:400:kworker.0 00010000:00080000:1.0:1788652098.541979:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3cbdc00 x1875537147683456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652098.541990:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147683456:0@lo:400:kworker.0 00000100:00100000:0.0F:1788652098.542522:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147683584 00000100:00100000:0.0:1788652098.542538:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147683584 00000100:00100000:0.0:1788652098.542570:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788652098.542577:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147683584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788652098.542707:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788652098.542761:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147683584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652098.542965:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788652098.542990:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788652098.542995:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788652098.542997:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788652098.543095:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147683072:0@lo:400:kworker.0 00000100:00100000:0.0:1788652098.543131:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652098.543175:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147681920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652098.543215:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147682048:0@lo:400:kworker.0 00000100:00100000:1.0:1788652098.543821:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147683072 00000100:00100000:1.0:1788652098.543828:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147683072 00000100:00100000:1.0:1788652098.543883:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788652098.543891:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147683072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652098.543970:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147683072:12345-0@lo:400:kworker.0 Request processed in 80us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652098.543977:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788652098.543994:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652098.544021:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147683072:0@lo:400:kworker.0 00000100:00100000:1.0:1788652098.544058:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147683584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652098.546147:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147682560:12345-0@lo:400:kworker.0 Request processed in 11955us (13823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652098.546170:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788652098.546263:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147682560:0@lo:400:kworker.0 00000100:00100000:0.0:1788652098.546398:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147682304:0@lo:400:kworker.0 00000100:00100000:0.0:1788652098.546445:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652098.546481:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147682816:0@lo:400:kworker.0 00000100:00100000:0.0:1788652098.546517:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652098.546535:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147683328:0@lo:400:kworker.0 00000100:00100000:0.0:1788652098.546563:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652098.546744:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147682304 00000100:00100000:3.0:1788652098.546752:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147682304 00000100:00100000:3.0:1788652098.546810:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147682816 00000100:00100000:3.0:1788652098.546814:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147682816 00000100:00100000:3.0:1788652098.546843:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788652098.546850:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147682304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652098.546901:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147682304:12345-0@lo:400:kworker.0 Request processed in 51us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652098.546927:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788652098.546939:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788652098.546946:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147682816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652098.546976:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147682816:12345-0@lo:400:kworker.0 Request processed in 30us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652098.546981:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788652098.546997:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652098.547789:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652098.547837:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147682688:0@lo:400:kworker.0 00000100:00100000:2.0:1788652098.547866:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652098.547883:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147683200:0@lo:400:kworker.0 00000100:00100000:3.0:1788652098.547928:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147682176 00000100:00100000:2.0:1788652098.547928:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147682688 00000100:00100000:3.0:1788652098.547933:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147682176 00000100:00100000:2.0:1788652098.547933:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147682688 00000100:00100000:3.0:1788652098.547965:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788652098.547965:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788652098.547972:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147682176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652098.547972:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147682688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652098.548015:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147682176:12345-0@lo:400:kworker.0 Request processed in 42us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652098.548019:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147682688:12345-0@lo:400:kworker.0 Request processed in 48us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652098.548022:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788652098.548034:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788652098.548040:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652098.549461:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147683328 00000100:00100000:1.0:1788652098.549475:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147683328 00000100:00100000:1.0:1788652098.549541:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788652098.549550:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147683328:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788652098.549622:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652098.549793:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652098.549840:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147683712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788652098.549887:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652098.549952:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147682176:0@lo:400:kworker.0 00000100:00100000:2.0:1788652098.549967:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147682688:0@lo:400:kworker.0 00000100:00100000:2.0:1788652098.549995:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147683712 00000100:00100000:2.0:1788652098.549999:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147683712 00000100:00100000:2.0:1788652098.550024:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788652098.550030:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147683712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788652098.550063:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25591488 pending 28672 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788652098.550105:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147683712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652098.550111:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788652098.550143:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147683712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788652098.550218:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147683200 00000100:00100000:3.0:1788652098.550222:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147683200 00000100:00100000:3.0:1788652098.550278:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788652098.550284:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147683200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652098.550324:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147683200:12345-0@lo:400:kworker.0 Request processed in 40us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652098.550330:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1788652098.550359:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c345b100 x1875537147683200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652098.550382:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147683200:0@lo:400:kworker.0 00000100:00080000:2.0:1788652098.550439:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788652098.550839:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147682304:0@lo:400:kworker.0 00000100:00100000:0.0:1788652098.550854:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147682816:0@lo:400:kworker.0 00000100:00100000:1.0:1788652098.553790:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147683328:12345-0@lo:400:kworker.0 Request processed in 4231us (7216us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652098.553816:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788652098.555787:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147683328:0@lo:400:kworker.0 00000040:00080000:3.0:1788652099.040163:0:17221:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788652099.040181:0:17221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788652099.040202:0:17221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788652099.040212:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788652099.112514:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652099.553173:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788652099.553204:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147683840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788652099.553274:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652099.553425:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147683840 00000100:00100000:1.0:1788652099.553435:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147683840 00000100:00100000:1.0:1788652099.553487:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788652099.553496:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147683840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788652099.553519:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788652099.553568:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147683840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652099.553575:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788652099.553619:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147683840:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788652100.130198:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652100.576116:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147683968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788652100.576197:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652100.576413:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147683968 00000100:00100000:2.0:1788652100.576422:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147683968 00000100:00100000:2.0:1788652100.576484:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788652100.576494:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147683968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788652100.576525:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788652100.576571:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147683968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652100.576577:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788652100.576618:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147683968:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788652100.582418:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147684096:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788652100.584001:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652100.584085:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147684096 00000100:00100000:2.0:1788652100.584094:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147684096 00000100:00100000:2.0:1788652100.584150:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788652100.584160:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147684096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788652100.584200:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788652100.584250:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147684096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652100.584270:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788652100.584325:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147684096:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1788652101.092375:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:1.0:1788652101.092394:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:3.0:1788652101.093695:0:17167:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1788652101.093720:0:17167:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f86ca848f00 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:3.0:1788652101.093726:0:17167:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86c6d1e100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f86ca848b40 00000020:00080000:3.0:1788652101.093730:0:17167:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86c6d1ee00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f85c3125c00 00000020:00080000:3.0:1788652101.093752:0:17224:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:3.0:1788652101.093820:0:17224:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788652101.094047:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5592 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652101.094059:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5592 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652101.094066:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5592 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652101.094072:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652101.094077:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5592 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652101.094084:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5592 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652101.094113:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86d455fa00) 00010000:00010000:1.0:1788652101.094116:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652101.094121:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5592 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652101.094128:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5592 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652101.153067:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652101.296418:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652101.296519:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652101.296556:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652101.296584:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652101.296607:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652101.296646:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652101.296679:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125588352 00000100:00100000:2.0:1788652101.296689:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125588352 00000100:00100000:2.0:1788652101.296759:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125588224 00000100:00100000:2.0:1788652101.296762:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125588224 00000100:00100000:2.0:1788652101.296777:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125588864 00000100:00100000:2.0:1788652101.296779:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125588864 00000100:00100000:2.0:1788652101.296789:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125588736 00000100:00100000:2.0:1788652101.296791:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125588736 00000100:00100000:2.0:1788652101.296805:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 77 00000100:00100000:2.0:1788652101.296813:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2390:x1875537125588352:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652101.296901:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2390:x1875537125588352:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 88us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652101.296938:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 77 00000100:00100000:2.0:1788652101.296955:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 78 00000100:00100000:2.0:1788652101.296962:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+12:2390:x1875537125588224:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652101.296986:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+12:2390:x1875537125588224:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 26us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652101.296992:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 78 00000100:00100000:2.0:1788652101.297003:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 79 00000100:00100000:2.0:1788652101.297008:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6da5325-c43d-45b2-9745-228d7048f21f+5:2391:x1875537125588864:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652101.297029:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6da5325-c43d-45b2-9745-228d7048f21f+5:2391:x1875537125588864:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 22us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652101.297045:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 79 00000100:00100000:2.0:1788652101.297057:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 80 00000100:00100000:2.0:1788652101.297063:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6da5325-c43d-45b2-9745-228d7048f21f+6:2391:x1875537125588736:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652101.297086:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6da5325-c43d-45b2-9745-228d7048f21f+6:2391:x1875537125588736:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 24us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652101.297092:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 80 00000100:00080000:2.0:1788652101.297108:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788652101.297112:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788652101.298819:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125588608 00000100:00100000:3.0:1788652101.298834:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125588608 00000100:00100000:3.0:1788652101.298900:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:3.0:1788652101.298932:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2391:x1875537125588608:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788652101.298999:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2391:x1875537125588608:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 91us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652101.299020:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00080000:3.0:1788652101.299046:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652101.299092:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652101.299348:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652101.299375:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652101.299393:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125588480 00000100:00100000:3.0:1788652101.299397:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125588480 00000100:00100000:3.0:1788652101.299422:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125588992 00000100:00100000:3.0:1788652101.299425:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125588992 00000100:00100000:3.0:1788652101.299756:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125589120 00000100:00100000:3.0:1788652101.299760:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125589120 00000100:00100000:3.0:1788652101.299785:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 32 00000100:00100000:3.0:1788652101.299791:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2387:x1875537125588480:12345-192.168.204.45@tcp:9:kworker.0 00000020:00000080:3.0:1788652101.299813:0:18693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c524a 00000100:00080000:3.0:1788652101.299831:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8f86f3d25000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788652101.299883:0:18693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788652101.300054:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+2:2387:x1875537125588480:12345-192.168.204.45@tcp:9:kworker.0 Request processed in 262us (961us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652101.300061:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 32 00000100:00100000:3.0:1788652101.300074:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:3.0:1788652101.300080:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6da5325-c43d-45b2-9745-228d7048f21f+5:2387:x1875537125588992:12345-192.168.204.45@tcp:9:kworker.0 00000020:00000080:3.0:1788652101.300090:0:18693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c5289 00000100:00080000:3.0:1788652101.300094:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8f85c3095800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788652101.300119:0:18693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788652101.300170:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6da5325-c43d-45b2-9745-228d7048f21f+2:2387:x1875537125588992:12345-192.168.204.45@tcp:9:kworker.0 Request processed in 90us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652101.300186:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:3.0:1788652101.300196:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 34 00000100:00100000:3.0:1788652101.300201:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6da5325-c43d-45b2-9745-228d7048f21f+5:2387:x1875537125589120:12345-192.168.204.45@tcp:9:kworker.0 00000020:00000080:3.0:1788652101.300210:0:18693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c5290 00000100:00080000:3.0:1788652101.300216:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8f85c3092800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788652101.300236:0:18693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788652101.300313:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6da5325-c43d-45b2-9745-228d7048f21f+2:2387:x1875537125589120:12345-192.168.204.45@tcp:9:kworker.0 Request processed in 111us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652101.300319:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 34 00010000:00010000:3.0:1788652101.300342:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788652101.300349:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652101.300352:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788652101.300794:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652101.301843:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125588096 00000100:00100000:1.0:1788652101.301855:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125588096 00010000:00010000:1.0:1788652101.301871:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652101.301945:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 170 00000100:00100000:1.0:1788652101.301954:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2390:x1875537125588096:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652101.302008:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2390:x1875537125588096:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 56us (5600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652101.302015:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 170 00000100:00100000:3.0:1788652101.383902:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652101.384016:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125589248 00000100:00100000:2.0:1788652101.384037:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125589248 00000100:00100000:2.0:1788652101.384106:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 74 00000100:00100000:2.0:1788652101.384117:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+12:15600:x1875537125589248:12345-192.168.204.45@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788652101.384233:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+12:15600:x1875537125589248:12345-192.168.204.45@tcp:60:lhsmtool_posix.0 Request processed in 117us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652101.384246:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 74 00000100:00100000:0.0:1788652101.386007:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652101.386092:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125589376 00000100:00100000:3.0:1788652101.386100:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125589376 00000100:00100000:3.0:1788652101.386174:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 75 00000100:00100000:3.0:1788652101.386185:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:15600:x1875537125589376:12345-192.168.204.45@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788652101.386294:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:15600:x1875537125589376:12345-192.168.204.45@tcp:60:lhsmtool_posix.0 Request processed in 111us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652101.386301:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 75 00000100:00100000:0.0:1788652101.387983:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652101.388615:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125589632 00000100:00100000:3.0:1788652101.388630:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125589632 00000100:00100000:3.0:1788652101.388731:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:3.0:1788652101.388744:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea1cac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+12:15600:x1875537125589632:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788652101.389034:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea1cac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+13:15600:x1875537125589632:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 293us (1058us total) trans 8589934636 rc 0/0 00000100:00100000:3.0:1788652101.389057:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 16 00010000:00010000:3.0:1788652102.176087:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652103.201036:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652103.648999:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652103.649512:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147684608:0@lo:400:kworker.0 00000100:00100000:1.0:1788652103.649592:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652103.649647:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788652103.649653:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147684480:0@lo:400:kworker.0 00000100:00100000:1.0:1788652103.649680:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652103.649851:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147684480 00000100:00100000:1.0:1788652103.649859:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147684480 00000100:00100000:1.0:1788652103.649900:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788652103.649933:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3636:x1875537147684480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652103.649993:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3636:x1875537147684480:12345-0@lo:400:kworker.0 Request processed in 85us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652103.650015:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788652103.650065:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147684480:0@lo:400:kworker.0 00000100:00100000:1.0:1788652103.650109:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147684608 00000100:00100000:1.0:1788652103.650113:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147684608 00000100:00100000:1.0:1788652103.650138:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788652103.650144:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147684608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652103.650180:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147684608:12345-0@lo:400:kworker.0 Request processed in 37us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652103.650187:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788652103.650206:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147684736:0@lo:400:kworker.0 00000100:00100000:1.0:1788652103.650286:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652103.650305:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652103.650311:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147684352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788652103.650333:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652103.650366:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147684352 00000100:00100000:1.0:1788652103.650369:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147684352 00000100:00100000:1.0:1788652103.650400:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788652103.650406:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147684352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788652103.650426:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788652103.650461:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147684352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652103.650467:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788652103.650482:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788652103.650507:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147684352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788652103.650526:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147684608:0@lo:400:kworker.0 00000100:00100000:1.0:1788652103.650568:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147684736 00000100:00100000:1.0:1788652103.650572:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147684736 00000100:00100000:1.0:1788652103.650602:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788652103.650608:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147684736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652103.650641:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147684736:12345-0@lo:400:kworker.0 Request processed in 34us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652103.650647:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788652103.658438:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147684864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652103.659763:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788652103.659884:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652103.659923:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147684224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652103.659923:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147684864 00000100:00100000:2.0:1788652103.659931:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147684864 00000100:00100000:3.0:1788652103.659957:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652103.660062:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147684224 00000100:00100000:2.0:1788652103.660066:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147684224 00000100:00100000:2.0:1788652103.660092:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788652103.660101:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147684864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788652103.660126:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788652103.660172:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147684864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652103.660178:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788652103.660207:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788652103.660212:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147684224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788652103.660242:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788652103.660265:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000100:00100000:2.0:1788652103.660269:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147684224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (311us total) trans 0 rc 0/0 00000004:00080000:3.0:1788652103.660271:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f85c3c89180, transno 8589934596 00000004:00080000:3.0:1788652103.660282:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:3.0:1788652103.660313:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147684864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652103.660329:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147684224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652103.660386:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788652103.660402:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652103.660432:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147684736:0@lo:400:kworker.0 00000100:00100000:2.0:1788652103.661392:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147684992:0@lo:400:kworker.0 00000100:00100000:2.0:1788652103.661438:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652103.661445:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147685120:0@lo:400:kworker.0 00000100:00100000:3.0:1788652103.661474:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652103.661492:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147684992 00000100:00100000:2.0:1788652103.661498:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147684992 00000100:00100000:2.0:1788652103.661532:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788652103.661551:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147684992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652103.661590:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147684992:12345-0@lo:400:kworker.0 Request processed in 40us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652103.661596:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788652103.661628:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147685120 00000100:00100000:2.0:1788652103.661632:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147685120 00000100:00100000:2.0:1788652103.661655:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788652103.661662:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147685120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652103.661694:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147685120:12345-0@lo:400:kworker.0 Request processed in 33us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652103.661700:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788652103.661702:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147685120:0@lo:400:kworker.0 00000100:00100000:3.0:1788652103.661715:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652103.661721:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147685504:0@lo:400:kworker.0 00000100:00100000:2.0:1788652103.661724:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147685376:0@lo:400:kworker.0 00000100:00100000:2.0:1788652103.661762:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652103.661763:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147684992:0@lo:400:kworker.0 00000100:00100000:2.0:1788652103.661795:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788652103.661802:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147685248:0@lo:400:kworker.0 00000100:00100000:2.0:1788652103.661825:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652103.661930:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147685888:0@lo:400:kworker.0 00000100:00100000:0.0:1788652103.661961:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652103.662190:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147685376 00000100:00100000:3.0:1788652103.662195:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147685376 00000100:00100000:3.0:1788652103.662222:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147685888 00000100:00100000:3.0:1788652103.662236:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147685888 00000100:00100000:3.0:1788652103.662266:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788652103.662272:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147685376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652103.662314:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147685376:12345-0@lo:400:kworker.0 Request processed in 42us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652103.662321:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788652103.662334:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788652103.662340:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147685888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652103.662364:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147685888:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652103.662370:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788652103.662387:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147685248 00000100:00100000:3.0:1788652103.662390:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147685248 00000100:00100000:3.0:1788652103.662418:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788652103.662423:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147685248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652103.662452:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147685248:12345-0@lo:400:kworker.0 Request processed in 29us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652103.662458:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788652103.662481:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652103.662486:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788652103.662491:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652103.662498:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147685632:0@lo:400:kworker.0 00000100:00100000:3.0:1788652103.662523:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652103.662559:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147685632 00000100:00100000:3.0:1788652103.662563:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147685632 00000100:00100000:3.0:1788652103.662602:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788652103.662609:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147685632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652103.662641:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147685632:12345-0@lo:400:kworker.0 Request processed in 33us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652103.662647:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788652103.662667:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788652103.662690:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c348f100 x1875537147685632/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652103.662702:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147685632:0@lo:400:kworker.0 00000100:00100000:3.0:1788652103.662725:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652103.662747:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147685504 00000100:00100000:3.0:1788652103.662750:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147685504 00000100:00100000:3.0:1788652103.662774:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788652103.662794:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147685504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652103.662828:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147685504:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652103.662833:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:3.0:1788652103.662847:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652103.662864:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147685504:0@lo:400:kworker.0 00000100:00100000:2.0:1788652103.662930:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147685760:0@lo:400:kworker.0 00010000:00080000:0.0:1788652103.662945:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb51880 x1875537147685888/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652103.662955:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652103.662955:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147685888:0@lo:400:kworker.0 00000100:00100000:0.0:1788652103.662965:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147685248:0@lo:400:kworker.0 00000100:00100000:0.0:1788652103.662985:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147685376:0@lo:400:kworker.0 00000100:00100000:3.0:1788652103.663879:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147685760 00000100:00100000:3.0:1788652103.663887:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147685760 00000100:00100000:3.0:1788652103.663963:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788652103.664891:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652103.666249:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147685760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652103.671945:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147685760:12345-0@lo:400:kworker.0 Request processed in 7968us (8982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652103.671956:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788652103.672097:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147685760:0@lo:400:kworker.0 00010000:00010000:1.0:1788652104.224410:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652104.672975:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788652104.672999:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147686016:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788652104.673084:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652104.673210:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147686016 00000100:00100000:3.0:1788652104.673221:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147686016 00000100:00100000:3.0:1788652104.673283:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788652104.673293:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147686016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788652104.673317:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788652104.673376:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147686016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652104.673397:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788652104.673950:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147686016:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788652105.248073:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788652105.398300:0:20564:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 19:48:23 (1788652103) 00000040:00080000:0.0:1788652105.572158:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788652105.696140:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652105.696164:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147686144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788652105.696243:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652105.697180:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147686144 00000100:00100000:2.0:1788652105.697189:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147686144 00000100:00100000:2.0:1788652105.697240:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788652105.697250:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147686144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788652105.697289:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788652105.697360:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147686144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652105.697367:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788652105.697390:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147686272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788652105.697403:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147686144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788652105.697415:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652105.697444:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147686272 00000100:00100000:2.0:1788652105.697447:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147686272 00000100:00100000:2.0:1788652105.697489:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788652105.697496:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147686272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788652105.697513:0:18173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788652105.697548:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147686272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652105.697554:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788652105.697581:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147686272:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788652106.274335:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652106.404563:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652106.404654:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652106.404687:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652106.404709:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652106.404730:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652106.404767:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652106.404798:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125590016 00000100:00100000:1.0:1788652106.404808:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125590016 00000100:00100000:1.0:1788652106.404874:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125590272 00000100:00100000:1.0:1788652106.404878:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125590272 00000100:00100000:1.0:1788652106.404891:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125589888 00000100:00100000:1.0:1788652106.404894:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125589888 00000100:00100000:1.0:1788652106.404938:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125590400 00000100:00100000:1.0:1788652106.404941:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125590400 00000100:00100000:1.0:1788652106.404958:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 87 00000100:00100000:1.0:1788652106.404966:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2389:x1875537125590016:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652106.405237:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2389:x1875537125590016:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 269us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652106.405254:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 87 00000100:00100000:1.0:1788652106.405271:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 88 00000100:00100000:1.0:1788652106.405278:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f6da5325-c43d-45b2-9745-228d7048f21f+6:2389:x1875537125590272:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652106.405301:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f6da5325-c43d-45b2-9745-228d7048f21f+6:2389:x1875537125590272:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 24us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652106.405307:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 88 00000100:00100000:1.0:1788652106.405317:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 89 00000100:00100000:1.0:1788652106.405322:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+13:2389:x1875537125589888:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652106.405412:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+13:2389:x1875537125589888:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 89us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652106.405418:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 89 00000100:00100000:1.0:1788652106.405430:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 90 00000100:00100000:1.0:1788652106.405436:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f6da5325-c43d-45b2-9745-228d7048f21f+5:2389:x1875537125590400:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652106.405459:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f6da5325-c43d-45b2-9745-228d7048f21f+5:2389:x1875537125590400:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 23us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652106.405463:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 90 00000100:00100000:1.0:1788652106.405482:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125590144 00000100:00100000:1.0:1788652106.405486:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125590144 00000100:00100000:1.0:1788652106.405513:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:1.0:1788652106.405519:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2389:x1875537125590144:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652106.405542:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2389:x1875537125590144:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 23us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652106.405547:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00080000:0.0:1788652106.406947:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652106.406954:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788652106.406957:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788652106.408452:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125589760 00000100:00100000:2.0:1788652106.408470:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125589760 00000100:00100000:2.0:1788652106.408567:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 172 00000100:00100000:2.0:1788652106.408578:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2389:x1875537125589760:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652106.408657:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2389:x1875537125589760:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 81us (4103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652106.408665:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 172 00000001:00080000:2.0:1788652107.238579:0:17167:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00080000:2.0:1788652107.238597:0:17167:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:0.0:1788652107.238957:0:17224:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:0.0:1788652107.238969:0:17224:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000001:00100000:0.0:1788652107.241185:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f6da5325-c43d-45b2-9745-228d7048f21f 00000020:00000080:0.0:1788652107.241195:0:18688:0:(genops.c:885:class_export_put()) final put ffff8f85c3090800/f6da5325-c43d-45b2-9745-228d7048f21f 00000001:00100000:0.0:1788652107.241443:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 13cd7710-0d0a-4bf8-8621-85bf9f039118 00000020:00000080:0.0:1788652107.241446:0:18688:0:(genops.c:885:class_export_put()) final put ffff8f86f3d20800/13cd7710-0d0a-4bf8-8621-85bf9f039118 00000020:00000080:3.0:1788652107.242172:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3090800/f6da5325-c43d-45b2-9745-228d7048f21f for lustre-OST0000 00000020:00000080:3.0:1788652107.242578:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f3d20800/13cd7710-0d0a-4bf8-8621-85bf9f039118 for lustre-OST0000 00000020:00000080:3.0:1788652107.242601:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3095800 for lustre-OST0000 00000020:00000080:3.0:1788652107.242606:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86f3d25000 for lustre-OST0000 00000001:00100000:3.0:1788652107.252622:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f6da5325-c43d-45b2-9745-228d7048f21f 00000020:00000080:3.0:1788652107.252632:0:19510:0:(genops.c:885:class_export_put()) final put ffff8f85c3091000/f6da5325-c43d-45b2-9745-228d7048f21f 00000020:00000080:0.0:1788652107.253714:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3091000/f6da5325-c43d-45b2-9745-228d7048f21f for lustre-OST0001 00000020:00000080:0.0:1788652107.253771:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3092800 for lustre-OST0001 00010000:00010000:1.0:1788652107.296125:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652108.320127:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652108.768258:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147686400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652108.768336:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652108.768659:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147686400 00000100:00100000:3.0:1788652108.768667:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147686400 00000100:00100000:3.0:1788652108.768722:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788652108.768732:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147686400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788652108.768759:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788652108.768799:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147686400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652108.768807:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788652108.768831:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147686656:0@lo:400:kworker.0 00000100:00100000:3.0:1788652108.768860:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652108.768883:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147687168:0@lo:400:kworker.0 00000100:00100000:3.0:1788652108.768928:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652108.768956:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f3d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147687680:0@lo:400:kworker.0 00000100:00100000:3.0:1788652108.768980:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652108.769010:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788652108.769016:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147686528:0@lo:400:kworker.0 00000100:00100000:3.0:1788652108.769044:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652108.769062:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147687040:0@lo:400:kworker.0 00000100:00100000:3.0:1788652108.769082:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652108.769096:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f3d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147687552:0@lo:400:kworker.0 00000100:00100000:3.0:1788652108.769114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788652108.769136:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652108.769147:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147687168 00000100:00100000:3.0:1788652108.769151:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147687168 00000100:00100000:3.0:1788652108.769183:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788652108.769190:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147687168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652108.769226:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147687168:12345-0@lo:400:kworker.0 Request processed in 37us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652108.769234:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788652108.769251:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652108.769261:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147686912:0@lo:400:kworker.0 00000100:00100000:3.0:1788652108.769285:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652108.769300:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f3d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147687424:0@lo:400:kworker.0 00000100:00100000:3.0:1788652108.769319:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652108.769332:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f3d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147687936:0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.769622:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147688064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652108.769686:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147686784:0@lo:400:kworker.0 00000100:00100000:0.0:1788652108.769759:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147687680 00000100:00100000:0.0:1788652108.769764:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147687680 00000100:00100000:0.0:1788652108.769802:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147687552 00000100:00100000:0.0:1788652108.769805:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147687552 00000100:00100000:0.0:1788652108.769818:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147686912 00000100:00100000:0.0:1788652108.769820:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147686912 00000100:00100000:0.0:1788652108.769830:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147687424 00000100:00100000:0.0:1788652108.769832:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147687424 00000100:00100000:0.0:1788652108.769844:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788652108.769850:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147687680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.776081:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652108.776198:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788652108.776216:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147687552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.776278:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147687552:12345-0@lo:400:kworker.0 Request processed in 70us (7162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652108.776285:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788652108.776313:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788652108.776320:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147686912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.776350:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147686912:12345-0@lo:400:kworker.0 Request processed in 31us (7064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652108.776370:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788652108.776383:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788652108.776389:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147687424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.776418:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147687424:12345-0@lo:400:kworker.0 Request processed in 29us (7098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652108.776425:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788652108.776445:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147686528 00000100:00100000:1.0:1788652108.776452:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147686528 00000100:00100000:1.0:1788652108.776489:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788652108.776495:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3636:x1875537147686528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.776525:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3636:x1875537147686528:12345-0@lo:400:kworker.0 Request processed in 31us (7481us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652108.776532:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788652108.776576:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147686656 00000100:00100000:1.0:1788652108.776580:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147686656 00000100:00100000:1.0:1788652108.776604:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147687040 00000100:00100000:1.0:1788652108.776607:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147687040 00000100:00100000:1.0:1788652108.776620:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788652108.776626:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147686656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.776657:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147686656:12345-0@lo:400:kworker.0 Request processed in 32us (7797us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652108.776664:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788652108.776674:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788652108.776680:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147687040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.776706:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147687040:12345-0@lo:400:kworker.0 Request processed in 26us (7622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652108.776712:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788652108.776752:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147688064 00000100:00100000:1.0:1788652108.776755:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147688064 00000100:00100000:1.0:1788652108.776778:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788652108.776784:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147688064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788652108.776807:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788652108.776882:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147688064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652108.776888:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788652108.776953:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147688064:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788652108.777021:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788652108.777027:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788652108.777029:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788652108.777090:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652108.777108:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147688192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788652108.777138:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652108.777162:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147688192 00000100:00100000:1.0:1788652108.777166:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147688192 00000100:00100000:1.0:1788652108.777192:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788652108.777197:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147688192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788652108.777208:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788652108.777237:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147688192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 40us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652108.777244:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788652108.777258:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788652108.777277:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147688192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788652108.777317:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147686528:0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.777328:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147687040:0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.777340:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f3d0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147687552:0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.777350:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147686656:0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.777361:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147687168:0@lo:400:kworker.0 00000100:00100000:2.0:1788652108.780038:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652108.780089:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f3d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147687296:0@lo:400:kworker.0 00000100:00100000:2.0:1788652108.780116:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652108.780159:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147686784 00000100:00100000:2.0:1788652108.780167:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147686784 00000100:00100000:2.0:1788652108.780220:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147687296 00000100:00100000:2.0:1788652108.780222:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147687296 00000100:00100000:2.0:1788652108.780239:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652108.780246:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147686784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652108.780290:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147686784:12345-0@lo:400:kworker.0 Request processed in 44us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652108.780297:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652108.780311:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788652108.780317:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147687296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652108.780341:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147687296:12345-0@lo:400:kworker.0 Request processed in 24us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652108.780346:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788652108.780412:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f3d0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147687296:0@lo:400:kworker.0 00000100:00100000:2.0:1788652108.780418:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f3d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147687808:0@lo:400:kworker.0 00000100:00100000:2.0:1788652108.780443:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652108.780465:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147687808 00000100:00100000:2.0:1788652108.780468:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147687808 00000100:00100000:2.0:1788652108.780500:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788652108.780506:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147687808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652108.780532:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147687808:12345-0@lo:400:kworker.0 Request processed in 27us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652108.780538:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:2.0:1788652108.780554:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652108.780569:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f3d0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147687808:0@lo:400:kworker.0 00000100:00100000:2.0:1788652108.780592:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147686784:0@lo:400:kworker.0 00000100:00100000:3.0:1788652108.783545:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652108.783778:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147687936 00000100:00100000:1.0:1788652108.783788:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147687936 00000100:00100000:1.0:1788652108.783859:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788652108.783868:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147687936:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788652108.784027:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788652108.784153:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147686400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652108.784220:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147686912:0@lo:400:kworker.0 00000100:00100000:3.0:1788652108.784234:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f3d0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147687424:0@lo:400:kworker.0 00000100:00100000:0.0:1788652108.784430:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147687680:12345-0@lo:400:kworker.0 Request processed in 14577us (15446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652108.784441:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1788652108.784564:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f3d0df80 x1875537147687680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652108.784577:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f3d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147687680:0@lo:400:kworker.0 00000100:00100000:1.0:1788652108.784868:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147687936:12345-0@lo:400:kworker.0 Request processed in 999us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652108.784876:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:3.0:1788652108.784963:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f3d0ea00 x1875537147687936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652108.784974:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f3d0ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147687936:0@lo:400:kworker.0 00000040:00080000:2.0:1788652109.280335:0:17221:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788652109.280347:0:17221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788652109.280366:0:17221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788652109.280376:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788652109.344623:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652109.352027:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652109.352068:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652109.352149:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652109.352285:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125590528 00000100:00100000:0.0:1788652109.352297:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125590528 00000100:00100000:0.0:1788652109.352352:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125590656 00000100:00100000:0.0:1788652109.352356:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125590656 00000100:00100000:0.0:1788652109.352383:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:0.0:1788652109.352393:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+14:2389:x1875537125590528:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788652109.352410:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652109.352431:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c5227 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ff3 expref: 14 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652109.352469:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652109.352534:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2389:x1875537125590528:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 142us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652109.352543:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:0.0:1788652109.352564:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:0.0:1788652109.352571:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:2389:x1875537125590656:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788652109.352579:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652109.352588:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f9800/0xcd2f56ea038c522e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34024 expref: 12 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652109.352597:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652109.352614:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:2389:x1875537125590656:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 45us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652109.352621:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:1.0:1788652109.352994:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125590912 00000100:00100000:1.0:1788652109.353000:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125590912 00000100:00100000:1.0:1788652109.353051:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 35 00000100:00100000:1.0:1788652109.353059:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2387:x1875537125590912:12345-192.168.204.45@tcp:9:umount.0 00000020:00000080:1.0:1788652109.353099:0:19081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c5251 00000020:00010000:1.0:1788652109.353107:0:19081:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f86f3d27000: total 0 00000100:00080000:1.0:1788652109.353112:0:19081:0:(import.c:65:import_set_state_nolock()) ffff8f86f3d21800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788652109.353164:0:19081:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00080000:3.0:1788652109.353283:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:3.0:1788652109.353310:0:17176:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f86f3d27000: total 0 00010000:00010000:3.0:1788652109.353313:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652109.353357:0:17176:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f86f3d27000, canceled 0 locks, left on hash table 1. 00002000:00010000:3.0:1788652109.353390:0:17176:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788652109.353393:0:17176:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 1788652093 -> 1788652094 00002000:00010000:3.0:1788652109.353396:0:17176:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788652093 -> 1788652094 00002000:00010000:3.0:1788652109.353398:0:17176:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788652109.353415:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ccbbabc/0xcd2f56ea038c55bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341ba expref: 5 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652109.353441:0:17176:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f86f3d27000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788652109.353453:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652109.353455:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652109.353456:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652109.353814:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652109.353872:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125591040 00000100:00100000:3.0:1788652109.353878:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125591040 00000100:00100000:3.0:1788652109.353952:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:3.0:1788652109.354020:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:2389:x1875537125591040:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652109.354032:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652109.354044:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c35c6e00/0xcd2f56ea038c52b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340da expref: 11 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652109.354054:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652109.354090:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+10:2389:x1875537125591040:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 132us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652109.354097:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:1.0:1788652109.354675:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+2:2387:x1875537125590912:12345-192.168.204.45@tcp:9:umount.0 Request processed in 1613us (2523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652109.354684:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 35 00000100:00100000:0.0:1788652109.368609:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652109.368758:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125591936 00000100:00100000:2.0:1788652109.368767:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125591936 00000100:00080000:3.0:1788652109.368869:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652109.368884:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 76 00000100:00100000:2.0:1788652109.368897:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+12:2387:x1875537125591936:12345-192.168.204.45@tcp:39:umount.0 00000020:00000080:2.0:1788652109.369279:0:19982:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c523c 00000020:00010000:2.0:1788652109.369296:0:19982:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f86f3d24800: total 0 00000100:00080000:2.0:1788652109.369302:0:19982:0:(import.c:65:import_set_state_nolock()) ffff8f86f3d22800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788652109.369332:0:19982:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000020:00010000:3.0:1788652109.369716:0:17175:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f86f3d24800: total 0 00010000:00010000:3.0:1788652109.369768:0:17175:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f86f3d24800, canceled 0 locks, left on hash table 7. 00010000:00010000:3.0:1788652109.369808:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368b00) 00010000:00010000:3.0:1788652109.369812:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788652109.369819:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503200/0xcd2f56ea038c5362 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340f6 expref: 12 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652109.369841:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652109.369844:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788652109.369848:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c550d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34182 expref: 11 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652109.369864:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652109.369866:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788652109.369869:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c55d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341c1 expref: 10 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652109.370533:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f86ee978700) 00010000:00010000:3.0:1788652109.370538:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788652109.370545:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5000/0xcd2f56ea038c5307 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340e1 expref: 8 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652109.370564:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:3.0:1788652109.370567:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788652109.370571:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c53e7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34120 expref: 7 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652109.370586:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86d455fa00) 00010000:00010000:3.0:1788652109.370589:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788652109.370592:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5568 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34197 expref: 6 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652109.370608:0:17175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86ee978500) 00010000:00010000:3.0:1788652109.370610:0:17175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652109.370614:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4c00/0xcd2f56ea038c5323 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340e8 expref: 5 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652109.370625:0:17175:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f86f3d24800, canceled 7 locks, left on hash table 0. 00010000:00010000:3.0:1788652109.370643:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652109.370645:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652109.370647:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652109.370697:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+3:2387:x1875537125591936:12345-192.168.204.45@tcp:39:umount.0 Request processed in 1802us (2096us total) trans 8589934637 rc 0/0 00000100:00100000:2.0:1788652109.370705:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 76 00000100:00100000:0.0:1788652109.380362:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652109.380520:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125592064 00000100:00100000:2.0:1788652109.380530:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125592064 00000100:00100000:2.0:1788652109.380615:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 77 00000100:00080000:3.0:1788652109.380619:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788652109.380628:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2387:x1875537125592064:12345-192.168.204.45@tcp:39:umount.0 00000020:00000080:2.0:1788652109.380665:0:17186:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c5243 00000100:00080000:2.0:1788652109.380682:0:17186:0:(import.c:65:import_set_state_nolock()) ffff8f86f3d25800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788652109.380716:0:17186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1788652109.381219:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652109.381363:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+3:2387:x1875537125592064:12345-192.168.204.45@tcp:39:umount.0 Request processed in 736us (1010us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788652109.381372:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 77 00000100:00100000:3.0:1788652109.792710:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652109.792739:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147688320:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788652109.792826:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652109.792987:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147688320 00000100:00100000:1.0:1788652109.792997:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147688320 00000100:00100000:1.0:1788652109.793058:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788652109.793069:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147688320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788652109.793095:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788652109.793155:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147688320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652109.793163:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788652109.793297:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147688320:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788652110.369062:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652110.816148:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652110.816168:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f3d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147688576:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788652110.816198:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147688448:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788652110.816233:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652110.816333:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652110.816334:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147688448 00000100:00100000:2.0:1788652110.816342:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147688448 00000100:00100000:2.0:1788652110.816385:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147688576 00000100:00100000:2.0:1788652110.816389:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147688576 00000100:00100000:3.0:1788652110.816397:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788652110.816462:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147688448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788652110.816515:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788652110.816570:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147688448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652110.816641:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147688448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652110.818655:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788652110.818709:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788652110.818725:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147688576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788652110.818761:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788652110.819306:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147688576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 587us (2969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652110.819314:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788652110.821673:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f3d0df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147688576:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788652111.392548:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652111.514386:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652111.514507:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652111.519088:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652111.523969:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125592320 00000100:00100000:0.0:1788652111.523985:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125592320 00000100:00100000:0.0:1788652111.524141:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125592192 00000100:00100000:0.0:1788652111.524163:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125592192 00000100:00100000:3.0:1788652111.525202:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652111.525527:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125592448 00000100:00100000:2.0:1788652111.525536:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125592448 00000100:00100000:2.0:1788652111.525584:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:2.0:1788652111.525595:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:2391:x1875537125592320:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652111.525612:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652111.525645:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f0907400/0xcd2f56ea038c526d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34094 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652111.525663:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652111.525721:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:2391:x1875537125592320:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 127us (11360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652111.525742:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:2.0:1788652111.525761:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:2.0:1788652111.525768:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+10:2391:x1875537125592192:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652111.525776:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652111.525785:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c5266 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34063 expref: 10 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652111.525794:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652111.525828:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+9:2391:x1875537125592192:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 61us (11322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652111.525835:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:2.0:1788652111.525849:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:2.0:1788652111.525856:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+8:2388:x1875537125592448:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652111.525863:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652111.525872:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4e00/0xcd2f56ea038c52ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340d3 expref: 8 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652111.525880:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652111.525897:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+7:2388:x1875537125592448:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 42us (6820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652111.525903:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:2.0:1788652111.526024:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125592704 00000100:00100000:2.0:1788652111.526029:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125592704 00000100:00100000:2.0:1788652111.526068:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 78 00000100:00100000:2.0:1788652111.526075:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6da5325-c43d-45b2-9745-228d7048f21f+6:2387:x1875537125592704:12345-192.168.204.45@tcp:39:umount.0 00000020:00000080:2.0:1788652111.526128:0:17187:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c527b 00000020:00010000:2.0:1788652111.526137:0:17187:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f85c32c8000: total 0 00000100:00080000:2.0:1788652111.526141:0:17187:0:(import.c:65:import_set_state_nolock()) ffff8f85c32c9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788652111.526164:0:17187:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00100000:2.0:1788652111.526763:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6da5325-c43d-45b2-9745-228d7048f21f+5:2387:x1875537125592704:12345-192.168.204.45@tcp:39:umount.0 Request processed in 684us (1566us total) trans 8589934638 rc 0/0 00000100:00100000:2.0:1788652111.526771:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 78 00000020:00010000:2.0:1788652111.526840:0:19250:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f85c32c8000: total 0 00010000:00010000:2.0:1788652111.526884:0:19250:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f85c32c8000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788652111.526950:0:19250:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368b00) 00010000:00010000:2.0:1788652111.526953:0:19250:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652111.526960:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c5370 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340fd expref: 4 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652111.526983:0:19250:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f85c32c8000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788652111.526996:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652111.526998:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652111.526999:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788652111.527019:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652111.527309:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652111.527345:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125592832 00000100:00100000:3.0:1788652111.527352:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125592832 00000100:00100000:3.0:1788652111.527663:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 97 00000100:00100000:3.0:1788652111.527687:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f6da5325-c43d-45b2-9745-228d7048f21f+5:2389:x1875537125592832:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788652111.527738:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f6da5325-c43d-45b2-9745-228d7048f21f+5:2389:x1875537125592832:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 53us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652111.527745:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 97 00000100:00080000:3.0:1788652111.527764:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788652111.539610:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652111.542482:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125592960 00000100:00100000:2.0:1788652111.542499:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125592960 00000100:00100000:2.0:1788652111.542647:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 79 00000100:00100000:2.0:1788652111.542657:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6da5325-c43d-45b2-9745-228d7048f21f+5:2387:x1875537125592960:12345-192.168.204.45@tcp:39:umount.0 00000020:00000080:2.0:1788652111.542698:0:17186:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c5282 00000100:00080000:2.0:1788652111.542709:0:17186:0:(import.c:65:import_set_state_nolock()) ffff8f86c3595800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788652111.544240:0:17186:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1788652111.544431:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6da5325-c43d-45b2-9745-228d7048f21f+3:2387:x1875537125592960:12345-192.168.204.45@tcp:39:umount.0 Request processed in 1763us (4819us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788652111.544460:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 79 00010000:00010000:3.0:1788652111.547312:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652111.587522:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652111.587788:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125593216 00000100:00100000:3.0:1788652111.587800:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125593216 00000100:00100000:3.0:1788652111.587871:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 174 00000100:00100000:3.0:1788652111.587881:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+7:2387:x1875537125593216:12345-192.168.204.45@tcp:251:umount.0 00000020:00000080:3.0:1788652111.587985:0:17181:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c5219 00000020:00010000:3.0:1788652111.587994:0:17181:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f85c3e68800: total 0 00000100:00080000:3.0:1788652111.587999:0:17181:0:(import.c:65:import_set_state_nolock()) ffff8f85c3e6e800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788652111.588096:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+3:2387:x1875537125593216:12345-192.168.204.45@tcp:251:umount.0 Request processed in 215us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652111.588104:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 174 00000020:00010000:0.0:1788652111.588271:0:17175:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f85c3e68800: total 0 00010000:00010000:0.0:1788652111.588276:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652111.588332:0:17175:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f85c3e68800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788652111.588367:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1502800/0xcd2f56ea038c5220 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fec expref: 2 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652111.588379:0:17175:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f85c3e68800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788652111.588388:0:17175:0:(genops.c:885:class_export_put()) final put ffff8f85c3e68800/b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d 00010000:00010000:0.0:1788652111.588407:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652111.588409:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652111.588411:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788652111.588513:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3e68800/b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d for MGS 00000020:00000080:2.0:1788652111.588554:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3e6e800 for MGS 00010000:00010000:2.0:1788652112.421999:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788652113.299171:0:20759:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788652113.315187:0:20759:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788652113.315240:0:20759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652113.315273:0:20759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652113.315281:0:20759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652113.315287:0:20759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652113.315739:0:20759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788652113.315746:0:20759:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788652113.315933:0:20759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788652113.315938:0:20759:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788652113.315945:0:20759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788652113.316106:0:20759:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788652113.316176:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652113.316185:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.316193:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652113.316197:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.316208:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652113.316216:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652113.316222:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652113.316224:0:17176:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788652113.316227:0:17176:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788652113.316257:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.316273:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788652113.316395:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147688832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652113.316474:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652113.317631:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.317646:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.317664:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652113.317667:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652113.317669:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652113.317792:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147688704:0@lo:39:umount.0 00000100:00100000:3.0:1788652113.317846:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652113.318358:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147688832 00000100:00100000:2.0:1788652113.318367:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147688832 00000100:00100000:2.0:1788652113.318428:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788652113.318438:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3385450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3636:x1875537147688832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652113.318451:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652113.318469:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c35c7600/0xcd2f56ea038c4de3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c4ddc expref: 24 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652113.318482:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652113.318530:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3385450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:3636:x1875537147688832:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (2056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652113.318537:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788652113.318618:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147688832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652113.324494:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147688704 00000100:00100000:1.0:1788652113.324515:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147688704 00000100:00100000:1.0:1788652113.324619:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788652113.324631:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875537147688704:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788652113.324663:0:17188:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4e0d 00000100:00080000:1.0:1788652113.324672:0:17188:0:(import.c:65:import_set_state_nolock()) ffff8f86eeabf800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788652113.324790:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3634:x1875537147688704:12345-0@lo:39:umount.0 Request processed in 161us (6942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652113.324797:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:1.0:1788652113.324821:0:17188:0:(genops.c:885:class_export_put()) final put ffff8f86eeabc800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788652113.324869:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788652113.324881:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86eeabc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788652113.324961:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86eeabf800 for lustre-MDT0000 00000100:00080000:2.0:1788652113.325468:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788652113.325491:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147688704:0@lo:39:umount.0 00000100:00080000:0.0:1788652113.325551:0:20759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788652113.325555:0:20759:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788652113.325560:0:20759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788652113.326510:0:20759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326527:0:20759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326533:0:20759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326539:0:20759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326561:0:20759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652113.326579:0:20759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326585:0:20759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326590:0:20759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326596:0:20759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326612:0:20759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788652113.326630:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652113.326637:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326644:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652113.326648:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326656:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652113.326664:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652113.326670:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652113.326673:0:17176:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788652113.326705:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326721:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652113.326748:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326755:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326770:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652113.326773:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326779:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906a00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652113.326782:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326789:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652113.326794:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652113.326799:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652113.326801:0:17176:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788652113.326804:0:17176:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788652113.326821:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326827:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652113.326833:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326851:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.326860:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652113.326862:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652113.326864:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652113.326883:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147689088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652113.326979:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652113.327022:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788652113.327028:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147688960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652113.327064:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652113.327096:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147689088 00000100:00100000:0.0:1788652113.327103:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147689088 00000100:00100000:0.0:1788652113.327141:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147688960 00000100:00100000:0.0:1788652113.327144:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147688960 00000100:00100000:0.0:1788652113.327164:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788652113.327172:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3638:x1875537147689088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652113.327184:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652113.327198:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f0907e00/0xcd2f56ea038c5147 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c5140 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327210:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652113.327244:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:3638:x1875537147689088:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652113.327251:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788652113.327267:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788652113.327273:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:3638:x1875537147688960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652113.327287:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652113.327296:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c35c6600/0xcd2f56ea038c4d34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c4d2d expref: 22 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327304:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652113.327326:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:3638:x1875537147688960:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652113.327332:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788652113.327367:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147688960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652113.327375:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147689088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652113.327400:0:20759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327409:0:20759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327415:0:20759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327421:0:20759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327433:0:20759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652113.327442:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652113.327447:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327453:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652113.327462:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327469:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652113.327476:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652113.327482:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788652113.327484:0:17175:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788652113.327486:0:17175:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788652113.327500:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327505:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652113.327517:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327523:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327532:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652113.327533:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652113.327535:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652113.327544:0:20759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327551:0:20759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327557:0:20759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327569:0:20759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327580:0:20759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788652113.327583:0:20759:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788652113.327585:0:20759:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788652113.327616:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652113.327620:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327626:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652113.327628:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327635:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652113.327642:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652113.327647:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652113.327649:0:17176:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788652113.327651:0:17176:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788652113.327664:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327670:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652113.327676:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327692:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652113.327700:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652113.327702:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652113.327704:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788652113.327717:0:20759:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788652113.327721:0:20759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788652113.327724:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788652113.327730:0:20759:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788652113.327734:0:20759:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f85c3097000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788652113.327739:0:20759:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f86c8038000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788652113.327743:0:20759:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f86c6e88000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788652113.327747:0:20759:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f85c2108000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788652113.327753:0:20759:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8f85c32c8000 f6da5325-c43d-45b2-9745-228d7048f21f 192.168.204.45@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1788652113.327757:0:20759:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8f86f3d24800 13cd7710-0d0a-4bf8-8621-85bf9f039118 192.168.204.45@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934636 stale:0 00000020:00080000:0.0:1788652113.327762:0:20759:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8f86fcd70000) has exports, disconnecting them 00000020:00080000:0.0:1788652113.327766:0:20759:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f85c3097000), last request at 1788652108 00000020:00000080:0.0:1788652113.327772:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c510f 00000100:00080000:0.0:1788652113.327785:0:20759:0:(import.c:65:import_set_state_nolock()) ffff8f85c3091800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788652113.327823:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788652113.327834:0:20759:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c3097000): rc 0 00000020:00000080:0.0:1788652113.327836:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f85c3097000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788652113.327845:0:20759:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f86c8038000), last request at 1788652108 00000020:00000080:0.0:1788652113.327848:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4faa 00000100:00080000:0.0:1788652113.327860:0:20759:0:(import.c:65:import_set_state_nolock()) ffff8f86c6d46000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788652113.327873:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3097000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788652113.327942:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3091800 for lustre-MDT0000 00010000:00010000:0.0:1788652113.327954:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788652113.327962:0:20759:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f86c8038000): rc 0 00000020:00000080:0.0:1788652113.327964:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86c8038000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788652113.327971:0:20759:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f86c6e88000), last request at 1788652033 00000020:00000080:0.0:1788652113.327975:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4efb 00000100:00080000:0.0:1788652113.327979:0:20759:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788652113.327990:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c8038000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788652113.328014:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86c6d46000 for lustre-MDT0000 00010000:00010000:0.0:1788652113.328022:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788652113.328031:0:20759:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f86c6e88000): rc 0 00000020:00000080:0.0:1788652113.328033:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86c6e88000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788652113.328039:0:20759:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f85c2108000), last request at 1788652033 00000020:00000080:0.0:1788652113.328043:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4e92 00000100:00080000:0.0:1788652113.328046:0:20759:0:(import.c:65:import_set_state_nolock()) ffff8f85c210b000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788652113.328055:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c6e88000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788652113.328084:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86c6e8e800 for lustre-MDT0000 00010000:00010000:0.0:1788652113.328093:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788652113.328102:0:20759:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000020:00080000:0.0:1788652113.328187:0:20759:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c2108000): rc 0 00000004:00000080:0.0:1788652113.328194:0:20759:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa71c08467ae0 00000100:00080000:0.0:1788652113.328218:0:20759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788652113.328221:0:20759:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788652113.329627:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652113.329659:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147689216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652113.329727:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652113.329781:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652113.329788:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147689344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652113.329825:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652113.329857:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147689216 00000100:00100000:2.0:1788652113.329864:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147689216 00000100:00100000:2.0:1788652113.329938:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147689344 00000100:00100000:2.0:1788652113.329942:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147689344 00000100:00100000:2.0:1788652113.329962:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788652113.329970:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:3635:x1875537147689216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652113.329997:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652113.330021:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c35c7c00/0xcd2f56ea038c52eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c52e4 expref: 22 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652113.330038:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652113.330074:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:3635:x1875537147689216:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652113.330083:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788652113.330099:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788652113.330105:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:3635:x1875537147689344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652113.330113:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652113.330122:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f9a00/0xcd2f56ea038c4d26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c4d1f expref: 20 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652113.330130:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652113.330151:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:3635:x1875537147689344:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652113.330157:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788652113.330189:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da710700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147689344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652113.330198:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147689216:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788652113.335607:0:20759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788652113.335653:0:20759:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788652113.335705:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147689472:0@lo:39:umount.0 00000100:00100000:2.0:1788652113.335778:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652113.335859:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147689472 00000100:00100000:1.0:1788652113.335869:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147689472 00000100:00100000:1.0:1788652113.336032:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788652113.336041:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875537147689472:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788652113.336072:0:17191:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4f25 00000100:00080000:1.0:1788652113.336080:0:17191:0:(import.c:65:import_set_state_nolock()) ffff8f85c19f1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788652113.336105:0:17191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00080000:0.0:1788652113.339372:0:20759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788652113.339403:0:20759:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1788652113.339429:0:20759:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788652113.339492:0:20759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788652113.339534:0:20759:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f3000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788652113.341646:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147689600:0@lo:9:umount.0 00000100:00100000:2.0:1788652113.341737:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652113.342001:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147689600 00000100:00100000:3.0:1788652113.342019:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147689600 00000100:00100000:3.0:1788652113.342096:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788652113.342108:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3634:x1875537147689600:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788652113.342141:0:18694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4ff0 00000100:00080000:3.0:1788652113.342152:0:18694:0:(import.c:65:import_set_state_nolock()) ffff8f86c4e7d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788652113.342202:0:18694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788652113.342356:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3634:x1875537147689600:12345-0@lo:9:umount.0 Request processed in 250us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652113.342377:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788652113.342398:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788652113.342409:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652113.342831:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3634:x1875537147689472:12345-0@lo:39:umount.0 Request processed in 6789us (7051us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788652113.342842:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00010000:1.0:1788652113.342865:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788652113.346805:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788652113.346824:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147689472:0@lo:39:umount.0 00000100:00080000:2.0:1788652113.346857:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f3000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788652113.346875:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788652113.346878:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788652113.346881:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147689600:0@lo:9:umount.0 00000100:00080000:0.0:1788652113.348854:0:20759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788652113.348863:0:20759:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1788652113.348885:0:20759:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788652113.349025:0:20759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788652113.349057:0:20759:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788652113.349106:0:20759:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8f86fcd70000) has no exports 00000100:00100000:2.0:1788652113.351379:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147689728:0@lo:9:umount.0 00000100:00100000:2.0:1788652113.351465:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652113.351726:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147689728 00000100:00100000:1.0:1788652113.351736:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147689728 00000100:00100000:1.0:1788652113.351805:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788652113.351816:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875537147689728:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788652113.351847:0:18692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c514e 00000100:00080000:1.0:1788652113.351859:0:18692:0:(import.c:65:import_set_state_nolock()) ffff8f85c32cd800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788652113.351932:0:18692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:1.0:1788652113.352244:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3634:x1875537147689728:12345-0@lo:9:umount.0 Request processed in 430us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652113.352252:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1788652113.352273:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788652113.352469:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788652113.352490:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788652113.352493:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788652113.352497:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147689728:0@lo:9:umount.0 00000100:00080000:2.0:1788652113.353032:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:0.0:1788652113.369066:0:20759:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8f86fcd70000) has no exports 00010000:00010000:3.0:1788652113.440025:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788652113.448223:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4d7a 00000020:00000080:0.0:1788652113.448242:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86d099e000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788652113.448269:0:20759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788652113.448404:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788652113.448415:0:20759:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788652113.448420:0:20759:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8f86fcd73380) has no exports 00000020:00000080:3.0:1788652113.448593:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86d099e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788652113.448935:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4d73 00000020:00000080:1.0:1788652113.448942:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86ea1e4000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788652113.449005:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788652113.449028:0:20759:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788652113.449031:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86ea1e5000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788652113.449034:0:20759:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea1e5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788652113.449043:0:20759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:3.0:1788652113.449216:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea1e4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788652113.890612:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652113.890641:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147689856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788652113.890731:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652113.891098:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147690112:0@lo:400:kworker.0 00000100:00100000:3.0:1788652113.891105:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147689984:0@lo:400:kworker.0 00000100:00100000:0.0:1788652113.891142:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652113.891151:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652113.891168:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147690624:0@lo:400:kworker.0 00000100:00100000:3.0:1788652113.891180:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147690496:0@lo:400:kworker.0 00000100:00100000:0.0:1788652113.891198:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652113.891224:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147689984 00000100:00100000:0.0:1788652113.891234:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788652113.891235:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147689984 00000100:00100000:0.0:1788652113.891242:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147690240:0@lo:400:kworker.0 00000100:00100000:0.0:1788652113.891266:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652113.891284:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147690752:0@lo:400:kworker.0 00000100:00100000:3.0:1788652113.891287:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788652113.891297:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875537147689984:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788652113.891306:0:17192:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788652113.891309:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652113.891343:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147690112 00000100:00100000:0.0:1788652113.891348:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147690112 00000100:00100000:3.0:1788652113.891354:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875537147689984:12345-0@lo:400:kworker.0 Request processed in 55us (202us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788652113.891361:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788652113.891392:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788652113.891401:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147690112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652113.891448:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147690112:12345-0@lo:400:kworker.0 Request processed in 49us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652113.891472:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788652113.891495:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147690624 00000100:00100000:0.0:1788652113.891498:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147690624 00000100:00100000:0.0:1788652113.891521:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147690240 00000100:00100000:0.0:1788652113.891523:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147690240 00000100:00100000:0.0:1788652113.891534:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147690752 00000100:00100000:0.0:1788652113.891538:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147690752 00000100:00100000:0.0:1788652113.891553:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788652113.891560:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147690752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652113.891594:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147690752:12345-0@lo:400:kworker.0 Request processed in 34us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652113.891600:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788652113.891611:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788652113.891615:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1875537147690624:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788652113.891619:0:19248:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788652113.891641:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1875537147690624:12345-0@lo:400:kworker.0 Request processed in 24us (443us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788652113.891647:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788652113.891658:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788652113.891661:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1875537147690240:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788652113.891665:0:19248:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788652113.891690:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3635:x1875537147690240:12345-0@lo:400:kworker.0 Request processed in 27us (424us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788652113.891696:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788652113.891736:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788652113.891741:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8f85c2add000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788652113.891746:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788652113.892816:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788652113.892864:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788652113.892878:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8f86c6d44800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788652113.892896:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788652113.892902:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8f86c6d44800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652113.892923:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 489 00000100:00080000:3.0:1788652113.892931:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f86c6d44800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652113.892963:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f3d0d180 x1875537147690880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788652113.892986:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147689984:0@lo:400:kworker.0 00000100:00100000:3.0:1788652113.893004:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652113.893065:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147690368:0@lo:400:kworker.0 00000100:00100000:3.0:1788652113.893107:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652113.893134:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f3d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147690880:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788652113.893279:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147690496 00000100:00100000:1.0:1788652113.893286:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147690496 00000100:00100000:1.0:1788652113.893318:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147690368 00000100:00100000:1.0:1788652113.893321:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147690368 00000100:00100000:1.0:1788652113.893331:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788652113.893338:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147690496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652113.893384:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147690496:12345-0@lo:400:kworker.0 Request processed in 46us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652113.893391:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788652113.893403:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652113.893407:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788652113.893412:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875537147690368:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788652113.893418:0:17187:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788652113.893444:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3638:x1875537147690368:12345-0@lo:400:kworker.0 Request processed in 31us (337us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788652113.893450:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788652113.893465:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147690880 00000100:00100000:3.0:1788652113.893471:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147690880 00000100:00100000:3.0:1788652113.893499:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788652113.893503:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00100000:3.0:1788652113.893507:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147690880:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788652113.893507:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8f86eeab9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788652113.893512:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788652113.893517:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8f86eeab9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652113.893520:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 507 00010000:02000000:3.0:1788652113.893525:0:17191:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1788652113.893526:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f86eeab9000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652113.893574:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff49f100 x1875537147691008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652113.893605:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147690368:0@lo:400:kworker.0 00010000:00080000:1.0:1788652113.893623:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86da711f80 x1875537147690496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652113.893633:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147690496:0@lo:400:kworker.0 00000100:00100000:1.0:1788652113.893653:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147691008:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788652113.893675:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652113.893696:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147691008 00000100:00100000:1.0:1788652113.893699:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147691008 00000100:00100000:1.0:1788652113.893713:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788652113.893717:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875537147691008:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:1.0:1788652113.893725:0:17187:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788652113.893748:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875537147691008:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 30us (72us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788652113.893754:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:1.0:1788652113.893772:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86eeab9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652113.893776:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788652113.893779:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147691008:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788652113.893870:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147689856 00000100:00100000:2.0:1788652113.893875:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147689856 00000100:00100000:2.0:1788652113.893945:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788652113.893954:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147689856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788652113.893986:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788652113.894029:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147689856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (3300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652113.894036:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1788652113.894054:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652113.894063:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788652113.894068:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652113.894246:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147689856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788652113.922595:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147690880:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 29083us (29330us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788652113.922610:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788652113.926248:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6d44800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652113.926261:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788652113.926265:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f3d0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147690880:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1788652113.938379:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8f85c2add000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652113.938395:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 489 00000100:00080000:0.0:1788652113.938405:0:3635:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f85c2add000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652113.938527:0:3635:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f67af800 x1875537147691136/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652113.938682:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875537147691136:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788652113.938762:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652113.938843:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147691136 00000100:00100000:0.0:1788652113.938851:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147691136 00000100:00100000:0.0:1788652113.938943:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788652113.938951:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875537147691136:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788652113.938971:0:19982:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788652113.939055:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147690240:0@lo:400:kworker.0 00010000:00080000:2.0:1788652113.939089:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86da712a00 x1875537147690752/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652113.939101:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147690752:0@lo:400:kworker.0 00000100:00100000:2.0:1788652113.939117:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147690112:0@lo:400:kworker.0 00000100:00080000:2.0:1788652113.939129:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788652113.939132:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8f85c3093800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788652113.939136:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788652113.939139:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8f85c3093800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788652113.939143:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 523 00000100:00080000:2.0:1788652113.939148:0:3635:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f85c3093800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652113.939163:0:3635:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f67af100 x1875537147691264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652113.939404:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147691264:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788652113.939436:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652113.939490:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875537147691136:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 538us (727us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788652113.939498:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147691264 00000100:00100000:0.0:1788652113.939498:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788652113.939503:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147691264 00000100:00100000:3.0:1788652113.939526:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788652113.939532:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875537147691264:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788652113.939550:0:19248:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788652113.939562:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147690624:0@lo:400:kworker.0 00000100:00100000:3.0:1788652113.939581:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875537147691264:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 48us (145us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788652113.939587:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788652113.939687:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c2add000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652113.939692:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788652113.939695:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875537147691136:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788652113.939712:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3093800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652113.939716:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788652113.939718:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147691264:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1788652114.464096:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652114.913643:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147691392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788652114.913741:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652114.913806:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147691392 00000100:00100000:1.0:1788652114.913815:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147691392 00000100:00100000:1.0:1788652114.913875:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788652114.913886:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f3d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147691392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788652114.913943:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788652114.913989:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f3d0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147691392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652114.913996:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788652114.914040:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147691392:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1788652114.915403:0:17918:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788652114.915418:0:17918:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1788652114.915423:0:17918:0:(genops.c:885:class_export_put()) final put ffff8f86c6d41800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788652114.915440:0:17918:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f6da5325-c43d-45b2-9745-228d7048f21f 00000001:00080000:1.0:1788652114.915532:0:17918:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1788652114.915535:0:17918:0:(genops.c:885:class_export_put()) final put ffff8f86c3590800/f6da5325-c43d-45b2-9745-228d7048f21f 00000001:00100000:1.0:1788652114.915542:0:17918:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 13cd7710-0d0a-4bf8-8621-85bf9f039118 00000001:00080000:1.0:1788652114.915546:0:17918:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1788652114.915548:0:17918:0:(genops.c:885:class_export_put()) final put ffff8f86f3d26800/13cd7710-0d0a-4bf8-8621-85bf9f039118 00000020:00000080:3.0:1788652114.917936:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c6d41800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788652114.918013:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c3590800/f6da5325-c43d-45b2-9745-228d7048f21f for lustre-MDT0001 00000020:00000080:3.0:1788652114.918038:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f3d26800/13cd7710-0d0a-4bf8-8621-85bf9f039118 for lustre-MDT0001 00000020:00000080:3.0:1788652114.918062:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c19f1800 for lustre-MDT0001 00000020:00000080:3.0:1788652114.918068:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86c3595800 for lustre-MDT0001 00000020:00000080:3.0:1788652114.918071:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86f3d25800 for lustre-MDT0001 00000001:00100000:3.0:1788652114.919473:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788652114.919481:0:19510:0:(genops.c:885:class_export_put()) final put ffff8f85c32cf800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788652114.919505:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 13cd7710-0d0a-4bf8-8621-85bf9f039118 00000020:00000080:3.0:1788652114.919507:0:19510:0:(genops.c:885:class_export_put()) final put ffff8f86f3d27000/13cd7710-0d0a-4bf8-8621-85bf9f039118 00000020:00000080:0.0:1788652114.919615:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32cf800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788652114.919659:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f3d27000/13cd7710-0d0a-4bf8-8621-85bf9f039118 for lustre-OST0001 00000020:00000080:0.0:1788652114.919676:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c32cd800 for lustre-OST0001 00000020:00000080:0.0:1788652114.919680:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86f3d21800 for lustre-OST0001 00000001:00100000:2.0:1788652114.919957:0:17167:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788652114.919962:0:17167:0:(genops.c:885:class_export_put()) final put ffff8f85c2108000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788652114.919983:0:17167:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f6da5325-c43d-45b2-9745-228d7048f21f 00000001:00080000:2.0:1788652114.919992:0:17167:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934638 is committed 00000020:00000080:2.0:1788652114.919995:0:17167:0:(genops.c:885:class_export_put()) final put ffff8f85c32c8000/f6da5325-c43d-45b2-9745-228d7048f21f 00000001:00100000:2.0:1788652114.919999:0:17167:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 13cd7710-0d0a-4bf8-8621-85bf9f039118 00000001:00080000:2.0:1788652114.920002:0:17167:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:2.0:1788652114.920004:0:17167:0:(genops.c:885:class_export_put()) final put ffff8f86f3d24800/13cd7710-0d0a-4bf8-8621-85bf9f039118 00000020:00000080:0.0:1788652114.920075:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2108000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788652114.920105:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32c8000/f6da5325-c43d-45b2-9745-228d7048f21f for lustre-MDT0000 00000020:00000080:0.0:1788652114.920127:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f3d24800/13cd7710-0d0a-4bf8-8621-85bf9f039118 for lustre-MDT0000 00000020:00000080:0.0:1788652114.920146:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c210b000 for lustre-MDT0000 00000020:00000080:0.0:1788652114.920151:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c32c9800 for lustre-MDT0000 00000020:00000080:0.0:1788652114.920153:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86f3d22800 for lustre-MDT0000 00010000:00010000:1.0:1788652115.488209:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788652115.488298:0:20759:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86ee8c1840 - data ffff8f86f86fdca8/ffff8f86f3d3d400 00000020:01000000:2.0:1788652115.488480:0:20759:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f85c205c2a0 - data ffff8f86f855fa20/ffff8f86efbbf400 00000001:00000004:2.0:1788652115.497307:0:20759:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934638 00000100:00080000:2.0:1788652115.583217:0:20759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788652115.583227:0:20759:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788652115.583243:0:20759:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8f86da710a80 x1875537147689472/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788652123 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652115.583271:0:20759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788652115.589613:0:20759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788652115.589622:0:20759:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1788652115.589648:0:20759:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788652115.589651:0:20759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788652115.591336:0:17210:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788652115.591345:0:17210:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788652115.591360:0:17210:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788652115.592232:0:20759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788652115.592238:0:20759:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1788652115.592256:0:20759:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788652115.592260:0:20759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788652115.593020:0:17212:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788652115.593025:0:17212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:2.0:1788652115.593035:0:17212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788652115.594337:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4d42 00000020:00000080:1.0:1788652115.594348:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86d126c800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788652115.595022:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86d126c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788652115.605892:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4d57 00000020:00000080:2.0:1788652115.605936:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f85c3473000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788652115.605956:0:20759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788652115.605961:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652115.605971:0:20759:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788652115.605976:0:20759:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8f86fcd74d40) has no exports 00000004:01000000:2.0:1788652115.606182:0:20759:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788652115.606191:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4db9 00000020:00000080:2.0:1788652115.606195:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f85c373e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788652115.606199:0:20759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788652115.606207:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652115.606212:0:20759:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788652115.606214:0:20759:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8f85c20f8000) has no exports 00000020:00000080:2.0:1788652115.606220:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4db2 00000020:00000080:2.0:1788652115.606238:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f85c3739000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788652115.606602:0:20759:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788652115.606607:0:20759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788652115.606611:0:20759:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1788652115.606617:0:20759:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788652115.606619:0:20759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788652115.606654:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652115.606660:0:20759:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788652115.606665:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4da4 00000020:00000080:2.0:1788652115.606669:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86f4b0c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788652115.606673:0:20759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788652115.606677:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652115.606680:0:20759:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788652115.606683:0:20759:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8f85c29319c0) has no exports 00000020:00000080:2.0:1788652115.606687:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4d9d 00000020:00000080:2.0:1788652115.606691:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86f4b0f800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788652115.607047:0:20759:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788652115.607051:0:20759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788652115.607053:0:20759:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1788652115.607057:0:20759:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788652115.607058:0:20759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788652115.607085:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652115.607090:0:20759:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788652115.607100:0:20759:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788652115.607105:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4d8f 00000020:00000080:2.0:1788652115.607110:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86f4b0b800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788652115.607113:0:20759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788652115.607117:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652115.607120:0:20759:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788652115.607121:0:20759:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8f85c2933380) has no exports 00000020:00000080:2.0:1788652115.607127:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4d88 00000020:00000080:2.0:1788652115.607129:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f85c3fbd800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788652115.609772:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3473000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788652115.609791:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c373e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788652115.609798:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3739000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788652115.609821:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c373a800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788652115.609831:0:8:0:(genops.c:885:class_export_put()) final put ffff8f86f4b0a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788652115.609835:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f4b0a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788652115.609840:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788652115.609959:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f4b0c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788652115.609966:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f4b0f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788652115.609971:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86f67f3000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788652115.609975:0:8:0:(genops.c:885:class_export_put()) final put ffff8f86f4b0e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788652115.609977:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f4b0e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788652115.609981:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788652115.610013:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f4b0b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788652115.610020:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3fbd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788652115.671066:0:20759:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788652115.671077:0:20759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788652115.671082:0:20759:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788652115.671091:0:20759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788652115.671157:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652115.671180:0:20759:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788652115.671208:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652115.671211:0:20759:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788652115.671218:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86d1268000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788652115.671222:0:20759:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86d1268000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788652115.671233:0:20759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788652115.671341:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4d5e 00000020:00000080:0.0:1788652115.671349:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f85c3474800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788652115.671354:0:20759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788652115.671358:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788652115.671364:0:20759:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788652115.671379:0:20759:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8f86fcd719c0) has no exports 00000020:00000080:0.0:1788652115.671402:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652115.671406:0:20759:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788652115.671411:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4d65 00000020:00000080:0.0:1788652115.671416:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f85c3477800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788652115.671425:0:20759:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86c3255800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788652115.671429:0:20759:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86c3255800 3 00000020:01000004:0.0:1788652115.671432:0:20759:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f86c3255800 from lustre-MDT0000 00000020:00000080:0.0:1788652115.671465:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652115.671469:0:20759:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788652115.671472:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86d126c000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788652115.671474:0:20759:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86d126c000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788652115.671482:0:20759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788652115.671513:0:20759:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788652115.671517:0:20759:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788652115.671521:0:20759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788652115.671523:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788652115.671526:0:20759:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788652115.671534:0:20759:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8f85c3cb4800 a28e2822-101e-46fe-b9c1-7a60e90536a9 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788652115.671540:0:20759:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8f85c2ae0000) has exports, disconnecting them 00000020:00080000:0.0:1788652115.671544:0:20759:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8f85c3cb4800), last request at 1788652017 00000020:00000080:0.0:1788652115.671559:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4d0a 00000020:00010000:0.0:1788652115.671563:0:20759:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f85c3cb4800: total 2 00000100:00080000:0.0:1788652115.671567:0:20759:0:(import.c:65:import_set_state_nolock()) ffff8f85c3cb7800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788652115.671580:0:20759:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c3cb4800): rc 0 00000020:00080000:0.0:1788652115.671585:0:20759:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8f85c2ae0000) has no exports 00000020:00000080:1.0:1788652115.671837:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3fbc000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788652115.671846:0:8:0:(genops.c:885:class_export_put()) final put ffff8f86d126f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788652115.671859:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86d126f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788652115.671867:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788652115.671954:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3474800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788652115.671958:0:8:0:(genops.c:885:class_export_put()) final put ffff8f86d126a800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788652115.671960:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86d126a800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788652115.671964:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788652115.671988:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3477800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1788652115.672021:0:17182:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8f86f4a95a00:17182] 2 exiting: rc = 0 00000100:00100000:1.0:1788652115.672122:0:17179:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8f86fce31600:17179] 0 exiting: rc = 1 00000100:00100000:0.0:1788652115.687144:0:17181:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8f85c317ca00:17181] 1 exiting: rc = 0 00000100:00100000:1.0:1788652115.687542:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687551:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687557:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687562:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687568:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687573:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687581:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687604:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687610:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687618:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687624:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687630:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687636:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687642:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687646:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687651:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687657:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687662:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687668:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687673:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687679:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687684:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687691:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687696:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687702:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687708:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687713:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687718:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687723:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687730:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687736:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687752:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687759:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687764:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687770:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687776:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687781:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687786:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687793:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687799:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687805:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687810:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687824:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687830:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687836:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687841:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687847:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687864:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687870:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687876:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687881:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687886:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687891:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687897:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687901:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687929:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687935:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687940:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687945:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687951:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687956:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687961:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687967:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652115.687972:0:20759:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1788652115.688960:0:17176:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f85c3cb4800: total 0 00010000:00010000:0.0:1788652115.689018:0:17176:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f85c3cb4800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788652115.689065:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f0906600/0xcd2f56ea038c4e45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c4e3e expref: 14 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689099:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f4b96400/0xcd2f56ea038c4d18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c4d11 expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689110:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f4b96800/0xcd2f56ea038c4f95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c4f8e expref: 12 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689121:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c35c7400/0xcd2f56ea038c52c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c52ba expref: 11 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689130:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c4ee6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c4edf expref: 10 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689139:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c50d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c50c9 expref: 9 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689149:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c52cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c52c8 expref: 8 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689159:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c52dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c52d6 expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689510:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f4b96c00/0xcd2f56ea038c4f6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c4f64 expref: 6 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689523:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c35c6200/0xcd2f56ea038c50fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c50f3 expref: 5 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689536:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f0906200/0xcd2f56ea038c5139 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c5132 expref: 4 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689561:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f4b97e00/0xcd2f56ea038c4e29 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c4e22 expref: 3 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689575:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f4b97800/0xcd2f56ea038c4e37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c4e30 expref: 2 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652115.689585:0:17176:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f85c3cb4800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788652115.689603:0:17176:0:(genops.c:885:class_export_put()) final put ffff8f85c3cb4800/a28e2822-101e-46fe-b9c1-7a60e90536a9 00010000:00010000:0.0:1788652115.689623:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652115.689626:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652115.689628:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788652115.689739:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3cb4800/a28e2822-101e-46fe-b9c1-7a60e90536a9 for MGS 00000020:00000080:1.0:1788652115.689878:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3cb7800 for MGS 00000020:01000000:1.0:1788652115.694276:0:20759:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f85c36da840 - data ffff8f86f87280d8/ffff8f85c10fe000 00000020:01000000:1.0:1788652115.694421:0:20759:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f85c1ae06c0 - data ffff8f86f8409870/ffff8f85c239c000 00000020:00000080:1.0:1788652115.695845:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4cee 00000020:00000080:1.0:1788652115.695868:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f85c3cb6800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788652115.695888:0:20759:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86c3255800 from MGS, refs=2 00000020:01000004:1.0:1788652115.695891:0:20759:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86c3255800 2 00000020:01000004:1.0:1788652115.695895:0:20759:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f86c3255800 from MGS 00000020:00000080:1.0:1788652115.695937:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788652115.695946:0:20759:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788652115.695948:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f85c3cb5800/MGS 00000020:00000080:1.0:1788652115.695967:0:20759:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3cb5800/MGS for MGS 00000020:01000000:1.0:1788652115.695974:0:20759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788652115.696048:0:20759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788652115.696052:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788652115.696058:0:20759:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788652115.696065:0:20759:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8f86f4b0c800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788652115.696072:0:20759:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8f85c20fcd40) has exports, disconnecting them 00000020:00080000:1.0:1788652115.696079:0:20759:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8f86f4b0c800), last request at 1788652017 00000020:00000080:1.0:1788652115.696083:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4df1 00000020:00080000:1.0:1788652115.696094:0:20759:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f86f4b0c800): rc 0 00000020:00000080:1.0:1788652115.696099:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86f4b0c800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788652115.696264:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3cb6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788652115.696276:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f4b0c800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788652115.727061:0:20759:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788652115.727073:0:20759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788652115.727078:0:20759:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788652115.727087:0:20759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788652115.727290:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652115.727299:0:20759:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788652115.727307:0:20759:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86c3255800 1 00000020:00000080:0.0:1788652115.727313:0:20759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4ce0 00000020:00000080:0.0:1788652115.727322:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f85c3cb1800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788652115.727328:0:20759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788652115.727333:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788652115.727337:0:20759:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788652115.727341:0:20759:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8f85c20f99c0) has no exports 00000020:00000080:2.0:1788652115.731062:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86f67f2000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788652115.731079:0:38:0:(genops.c:885:class_export_put()) final put ffff8f85c373b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788652115.731082:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c373b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788652115.731096:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788652115.731180:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3cb1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000040:00080000:2.0:1788652115.820551:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:2.0:1788652115.899964:0:20759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652115.899977:0:20759:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788652115.899984:0:20759:0:(genops.c:885:class_export_put()) final put ffff8f86c3250800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788652115.899988:0:20759:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c3250800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788652115.899993:0:20759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788652115.900114:0:20759:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f86c3256000 00000020:02000400:2.0:1788652115.900184:0:20759:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788652116.526037:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652117.537592:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652118.560413:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788652119.009250:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788652119.009257:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788652119.009267:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f86c6d44800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652119.009276:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 569 00000100:00080000:0.0:1788652119.009282:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788652119.009288:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f86c6d44800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652119.009314:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86da710a80 x1875537147691648/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788652119.009354:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788652119.009358:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788652119.009359:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f85c2add000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652119.009363:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 569 00000100:00080000:0.0:1788652119.009365:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788652119.009368:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f85c2add000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652119.009379:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86da712a00 x1875537147692032/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788652119.009387:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788652119.009391:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788652119.009392:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f86eeab9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652119.009395:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 569 00000100:00080000:0.0:1788652119.009398:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788652119.009401:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f86eeab9000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652119.009411:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86da713b80 x1875537147692160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788652119.009425:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788652119.009428:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788652119.009434:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f85c3093800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652119.009437:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 569 00000100:00080000:0.0:1788652119.009440:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788652119.009443:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f85c3093800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652119.009452:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86da710380 x1875537147692416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788652119.009484:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147691648:0@lo:38:kworker.0 00000100:00100000:0.0:1788652119.009548:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652119.009596:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875537147692032:0@lo:38:kworker.0 00000100:00100000:0.0:1788652119.009619:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652119.009637:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147692160:0@lo:38:kworker.0 00000100:00100000:0.0:1788652119.009652:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652119.012953:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147691520:0@lo:400:kworker.0 00000400:00000100:1.0:1788652119.013010:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875537147691520 offset 0 length 224: 4 00000100:00100000:0.0:1788652119.013174:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147692416:0@lo:38:kworker.0 00000100:00100000:0.0:1788652119.013213:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652119.013261:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147691776:0@lo:400:kworker.0 00000100:00100000:0.0:1788652119.013290:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652119.013312:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147692672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788652119.013336:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652119.013362:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788652119.013368:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147691904:0@lo:400:kworker.0 00000100:00100000:0.0:1788652119.013403:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652119.013444:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147692032 00000100:00100000:0.0:1788652119.013452:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147692032 00000100:00100000:0.0:1788652119.013485:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147692160 00000100:00100000:0.0:1788652119.013488:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147692160 00000100:00100000:0.0:1788652119.013514:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147692416 00000100:00100000:0.0:1788652119.013517:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147692416 00000100:00100000:0.0:1788652119.013531:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788652119.013538:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147692032:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788652119.013559:0:17186:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788652119.014308:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147692544:0@lo:400:kworker.0 00000100:00100000:1.0:1788652119.014351:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652119.014373:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652119.014379:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147692288:0@lo:400:kworker.0 00000100:00100000:1.0:1788652119.014401:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652119.014609:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147691648 00000100:00100000:3.0:1788652119.014615:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147691648 00000100:00100000:3.0:1788652119.014647:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788652119.014654:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875537147691648:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788652119.014669:0:18173:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788652119.014716:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875537147691648:12345-0@lo:38:kworker.0 Request processed in 62us (5167us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788652119.014724:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788652119.014744:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147692544 00000100:00100000:3.0:1788652119.014747:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147692544 00000100:00100000:3.0:1788652119.014777:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147692288 00000100:00100000:3.0:1788652119.014780:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147692288 00000100:00100000:3.0:1788652119.014824:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788652119.014830:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147692544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652119.014871:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147692544:12345-0@lo:400:kworker.0 Request processed in 41us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652119.014877:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788652119.014891:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788652119.014897:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147692288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652119.014949:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147692288:12345-0@lo:400:kworker.0 Request processed in 52us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652119.014956:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788652119.014969:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788652119.014972:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875537147692160:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788652119.014983:0:17187:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788652119.015007:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875537147692160:12345-0@lo:38:kworker.0 Request processed in 33us (5353us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788652119.015013:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788652119.015026:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788652119.015030:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875537147692416:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788652119.015039:0:17187:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788652119.015063:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875537147692416:12345-0@lo:38:kworker.0 Request processed in 31us (1850us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788652119.015068:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788652119.015086:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788652119.017132:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147692672 00000100:00100000:3.0:1788652119.017149:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147692672 00000100:00100000:3.0:1788652119.017209:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788652119.017227:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147692672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788652119.017259:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788652119.017339:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147692672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (4000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652119.017347:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788652119.017370:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147691776 00000100:00100000:3.0:1788652119.017374:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147691776 00010000:00080000:1.0:1788652119.017630:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8f86da711f80 x1875537147692288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652119.017645:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147692288:0@lo:400:kworker.0 00010000:00080000:1.0:1788652119.017658:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8f86da713480 x1875537147692544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652119.017667:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147692544:0@lo:400:kworker.0 00000100:00100000:1.0:1788652119.020751:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147691904 00000100:00100000:1.0:1788652119.020793:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147691904 00000100:00100000:1.0:1788652119.020852:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788652119.020861:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147691904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652119.020964:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147691904:12345-0@lo:400:kworker.0 Request processed in 103us (7560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652119.020972:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788652119.024043:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788652119.024062:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147691776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652119.024153:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147691776:12345-0@lo:400:kworker.0 Request processed in 99us (10861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652119.024161:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1788652119.024189:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652119.024195:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788652119.024246:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6d44800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788652119.024252:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788652119.024256:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147691648:0@lo:38:kworker.0 00000100:00080000:3.0:1788652119.024268:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86eeab9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788652119.024272:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788652119.024275:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147692160:0@lo:38:kworker.0 00000100:00080000:3.0:1788652119.024286:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3093800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788652119.024289:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788652119.024291:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147692416:0@lo:38:kworker.0 00000100:00100000:3.0:1788652119.024342:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da710000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147691904:0@lo:400:kworker.0 00000100:00100000:3.0:1788652119.024355:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147691776:0@lo:400:kworker.0 00000100:00100000:3.0:1788652119.024385:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147692672:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788652119.027019:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788652119.027029:0:18688:0:(genops.c:885:class_export_put()) final put ffff8f86c4e78000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788652119.037046:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c4e78000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788652119.037118:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86c4e7d800 for lustre-OST0000 00000100:00100000:0.0:1788652119.040497:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147692032:12345-0@lo:38:kworker.0 Request processed in 26949us (30868us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788652119.040513:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1788652119.040576:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c2add000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652119.040581:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788652119.040585:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875537147692032:0@lo:38:kworker.0 00010000:00010000:3.0:1788652119.584136:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788652119.973359:0:20960:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788652119.997371:0:20960:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788652119.997435:0:20960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652119.997465:0:20960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652119.997474:0:20960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652119.997489:0:20960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652119.997527:0:20960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788652119.997533:0:20960:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788652119.997572:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788652119.997576:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788652119.997583:0:20960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788652119.997595:0:20960:0:(import.c:65:import_set_state_nolock()) ffff8f85c2add000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1788652119.997597:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:3.0:1788652119.997601:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788652119.997605:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00010000:00010000:2.0:1788652119.997606:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652119.997608:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788652119.997619:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788652119.997623:0:19250:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652119.997632:0:19250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652119.997640:0:19250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652119.997646:0:19250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788652119.997649:0:19250:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788652119.997666:0:19250:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788652119.997716:0:19250:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652119.997723:0:19250:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652119.997762:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652119.997812:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652119.997833:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147692800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652119.997941:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652119.997951:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788652119.997956:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652119.997958:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652119.997960:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652119.998014:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147692800 00000100:00100000:1.0:1788652119.998021:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147692800 00000100:00100000:1.0:1788652119.998066:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788652119.998073:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3635:x1875537147692800:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788652119.998091:0:17174:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788652119 with bad export cookie 14785131664762490122 00010000:00010000:3.0:1788652120.000799:0:20960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.000819:0:20960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.000841:0:20960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.000848:0:20960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.000877:0:20960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652120.000885:0:20960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652120.000946:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652120.000957:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652120.000967:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652120.000971:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652120.000981:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652120.000988:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652120.000994:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652120.000996:0:17176:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:0.0:1788652120.001037:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652120.001055:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788652120.001124:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a28e2822-101e-46fe-b9c1-7a60e90536a9:3637:1875537147692928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652120.001439:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652120.002187:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652120.002198:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652120.002214:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652120.002216:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652120.002219:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652120.002999:0:20960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.003008:0:20960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.003015:0:20960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.003038:0:20960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652120.003046:0:20960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.003053:0:20960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.003059:0:20960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.003080:0:20960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.003095:0:20960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788652120.003102:0:20960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.003109:0:20960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.003116:0:20960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.003123:0:20960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652120.003123:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652120.003132:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652120.003136:0:20960:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788652120.003144:0:20960:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1788652120.003145:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906000 already unused, calling callback (ffffffffc149cc20) 10000000:01000000:3.0:1788652120.003150:0:20960:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 10000000:00010000:2.0:1788652120.003152:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652120.003163:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652120.003171:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788652120.003185:0:20960:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788652120.003189:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788652120.003194:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788652120.003201:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788652120.003208:0:20960:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8f85c35cd000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1788652120.003212:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:00080000:3.0:1788652120.003217:0:20960:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8f86edd6f800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:0.0:1788652120.003219:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788652120.003225:0:20960:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8f85c2ae19c0) has exports, disconnecting them 00000020:00080000:3.0:1788652120.003233:0:20960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f85c35cd000), last request at 1788652119 00010000:00010000:0.0:1788652120.003233:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652120.003239:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788652120.003243:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c5124 00010000:00010000:0.0:1788652120.003249:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652120.003264:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788652120.003267:0:20960:0:(import.c:65:import_set_state_nolock()) ffff8f85c35ce800 : changing import state from FULL to CLOSED 10000000:01000000:0.0:1788652120.003272:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788652120.003276:0:17176:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788652120.003279:0:17176:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00080000:3.0:1788652120.003316:0:20960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c35cd000): rc 0 00010000:00010000:0.0:1788652120.003317:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788652120.003321:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f85c35cd000/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:0.0:1788652120.003341:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:3.0:1788652120.003342:0:20960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f86edd6f800), last request at 1788652119 00000020:00000080:3.0:1788652120.003348:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4fbf 00000100:00080000:3.0:1788652120.003356:0:20960:0:(import.c:65:import_set_state_nolock()) ffff8f86c4e7e000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788652120.003364:0:20960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f86edd6f800): rc 0 00010000:00010000:0.0:1788652120.003365:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788652120.003367:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86edd6f800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788652120.003377:0:20960:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa71c00ddbae0 00010000:00010000:0.0:1788652120.003377:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652120.003393:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652120.003397:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788652120.003400:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788652120.003406:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788652120.003407:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652120.003413:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652120.003421:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652120.003427:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652120.003433:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652120.003435:0:17176:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788652120.003437:0:17176:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788652120.003452:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652120.003522:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652120.003541:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652120.003560:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652120.003578:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652120.003580:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652120.003581:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652120.003590:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788652120.003607:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147693184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652120.003687:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652120.003745:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147692928 00000100:00100000:0.0:1788652120.003753:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147692928 00000100:00100000:0.0:1788652120.003801:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147693184 00000100:00100000:0.0:1788652120.003805:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147693184 00000100:00100000:0.0:1788652120.003819:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788652120.003828:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3637:x1875537147692928:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788652120.003834:0:17173:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788652120 with bad export cookie 14785131664762490122 00000100:00100000:0.0:1788652120.003880:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3637:x1875537147692928:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (2442us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788652120.003888:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788652120.003904:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652120.003929:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3387450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3636:x1875537147693184:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788652120.003934:0:17173:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788652120 with bad export cookie 14785131664762490122 00000100:00100000:0.0:1788652120.003964:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3387450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3636:x1875537147693184:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (278us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788652120.003970:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788652120.004005:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.145@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788652120.004015:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8f85c3cb2000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788652120.004019:0:3636:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.145@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 10000000:01000000:2.0:1788652120.004066:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788652120.004074:0:17175:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788652120.004076:0:17175:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00080000:3.0:1788652120.005251:0:20960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788652120.005267:0:20960:0:(import.c:65:import_set_state_nolock()) ffff8f86c6d44800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788652120.006227:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788652120.006232:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788652120.006245:0:20960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788652120.006322:0:20960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788652120.006356:0:20960:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8f800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788652120.006375:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788652120.006377:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1788652120.006389:0:20960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788652120.006864:0:20960:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788652120.006883:0:20960:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788652120.007044:0:20960:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8f85c2ae19c0) has no exports 00000020:00000080:3.0:1788652120.023067:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c35cd000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788652120.023265:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86edd6f800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788652120.023292:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c35ce800 for lustre-MDT0001 00000020:00000080:3.0:1788652120.023297:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86c4e7e000 for lustre-MDT0001 00000100:00080000:0.0:1788652120.023758:0:3636:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.145@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788652120.023776:0:3636:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788652120.023786:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86da713100 x1875537147691520/t0(0) o400->MGC192.168.204.145@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788652135 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652120.023799:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f67af800 x1875537147692800/t0(0) o103->MGC192.168.204.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788652135 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652120.023809:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86efa37b80 x1875537147692928/t0(0) o103->MGC192.168.204.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788652135 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652120.023818:0:3636:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86efa35f80 x1875537147693184/t0(0) o103->MGC192.168.204.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788652136 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788652120.025008:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652120.025023:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652120.025039:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652120.025046:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652120.025080:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652120.025085:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652120.025088:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652120.026169:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147692800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652120.026199:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652120.026217:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1875537147693568:0@lo:13:osp-pre-0-1.0 10000000:01000000:0.0:1788652120.028358:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788652120.028368:0:3636:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788652120.028370:0:3636:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788652120.028375:0:3636:0:(import.c:65:import_set_state_nolock()) ffff8f85c3cb2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652120.028383:0:3636:0:(import.c:545:import_select_connection()) MGC192.168.204.145@tcp: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1788652120.028394:0:3636:0:(import.c:665:import_select_connection()) MGC192.168.204.145@tcp: import ffff8f85c3cb2000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652120.028427:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147693312:0@lo:9:umount.0 00000100:00100000:0.0:1788652120.028861:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652120.029277:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147693312 00000100:00100000:2.0:1788652120.029286:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147693312 00000100:00100000:2.0:1788652120.029346:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788652120.029358:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1875537147693312:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788652120.029387:0:19081:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4fe9 00000100:00080000:2.0:1788652120.029399:0:19081:0:(import.c:65:import_set_state_nolock()) ffff8f85c1977800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788652120.029405:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147693440:0@lo:9:umount.0 00000100:00100000:0.0:1788652120.029448:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:2.0:1788652120.029453:0:19081:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788652120.029866:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:0:1875537147693056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652120.029882:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147691520:0@lo:400:kworker.0 00000100:00100000:3.0:1788652120.029903:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652120.029922:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:0:1875537147693696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652120.034228:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147693440 00000100:00100000:1.0:1788652120.034238:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147693440 00000100:00100000:1.0:1788652120.034294:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788652120.034303:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3634:x1875537147693440:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788652120.034330:0:18693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c5155 00000100:00080000:1.0:1788652120.034341:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8f85c3094000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788652120.034387:0:18693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:2.0:1788652120.034938:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3634:x1875537147693312:12345-0@lo:9:umount.0 Request processed in 5581us (6074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652120.034948:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1788652120.034995:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652120.035366:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3634:x1875537147693440:12345-0@lo:9:umount.0 Request processed in 1063us (5916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652120.035383:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1788652120.035424:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652120.035429:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:1.0:1788652120.035454:0:17174:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875537147692800 offset 224 length 224: 4 00000100:00100000:1.0:1788652120.035540:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3635:x1875537147692800:12345-0@lo:103:ldlm_bl.0 Request processed in 37466us (37588us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788652120.035549:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788652120.035665:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a28e2822-101e-46fe-b9c1-7a60e90536a9:3637:1875537147692928:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788652120.035712:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788652120.035734:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788652120.035736:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788652120.035740:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147693440:0@lo:9:umount.0 00000100:00080000:0.0:1788652120.035780:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8f800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788652120.035789:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788652120.035790:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788652120.035793:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147693312:0@lo:9:umount.0 00000100:00100000:0.0:1788652120.035831:0:3636:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86efa37b80 x1875537147693824/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788652120.035862:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a28e2822-101e-46fe-b9c1-7a60e90536a9:3634:1875537147693824:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788652120.035887:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875537147693824 offset 0 length 520: 4 00000100:00100000:0.0:1788652120.035937:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147693184:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788652120.053111:0:20960:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8f85c2ae19c0) has no exports 00000020:01000000:1.0:1788652120.126602:0:20960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86ee8c1a20 - data ffff8f86f84a9000/ffff8f86f3d3fc00 00000020:01000000:1.0:1788652120.126842:0:20960:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86d135fe40 - data ffff8f86f8748000/ffff8f86efbb5400 00000001:00000004:1.0:1788652120.146423:0:20960:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1788652120.200593:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788652120.200603:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788652120.200626:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788652120.203541:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788652120.203548:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788652120.203572:0:20960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788652120.203575:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788652120.203996:0:17926:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788652120.204002:0:17926:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788652120.204013:0:17926:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788652120.205527:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788652120.205534:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1788652120.205588:0:20960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788652120.205591:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788652120.206476:0:17928:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788652120.206481:0:17928:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:0.0:1788652120.206492:0:17928:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788652120.207653:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4e53 00000020:00000080:2.0:1788652120.207664:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f85c210a000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788652120.208583:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4e68 00000020:00000080:2.0:1788652120.208593:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86edd68000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788652120.208599:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788652120.208619:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652120.208629:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788652120.208634:0:20960:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8f85c2ae3380) has no exports 00000004:01000000:2.0:1788652120.208933:0:20960:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788652120.208943:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4ebc 00000020:00000080:2.0:1788652120.208948:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86c6f10000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788652120.208953:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788652120.208957:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652120.208962:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788652120.208965:0:20960:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8f86eebab380) has no exports 00000020:00000080:2.0:1788652120.208982:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4eb5 00000020:00000080:2.0:1788652120.208985:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86c6e89800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1788652120.209478:0:20960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788652120.209482:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788652120.209487:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1788652120.209494:0:20960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788652120.209509:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788652120.209537:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652120.209544:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788652120.209549:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4ea7 00000020:00000080:2.0:1788652120.209553:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86c6e88800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788652120.209557:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788652120.209560:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652120.209563:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788652120.209565:0:20960:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8f86eebacd40) has no exports 00000020:00000080:2.0:1788652120.209570:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4ea0 00000020:00000080:2.0:1788652120.209573:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86c6e8b000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788652120.210303:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c210a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788652120.210314:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86edd68000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1788652120.210319:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c6f10000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788652120.210324:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c6e89800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788652120.210329:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86c6e8e000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788652120.210335:0:38:0:(genops.c:885:class_export_put()) final put ffff8f86c6e8d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788652120.210338:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c6e8d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788652120.210342:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788652120.210416:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c6e88800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788652120.210421:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c6e8b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788652120.210553:0:20960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788652120.210558:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788652120.210561:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788652120.210565:0:20960:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788652120.210567:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788652120.210607:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652120.210901:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86c6e8f800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788652120.211003:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788652120.211007:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86c6d40000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788652120.211010:0:20960:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c6d40000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788652120.211015:0:20960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788652120.211085:0:20960:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788652120.211093:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4e8b 00000020:00000080:2.0:1788652120.211100:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86c6cf5000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788652120.211115:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788652120.211119:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652120.211124:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788652120.211128:0:20960:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8f86eeba99c0) has no exports 00000020:00000080:2.0:1788652120.211133:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4e84 00000020:00000080:2.0:1788652120.211137:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86c6d44000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788652120.211692:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c6cf5000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788652120.211711:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c6d44000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788652120.216984:0:20960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788652120.216995:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788652120.217001:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788652120.217010:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788652120.217113:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652120.217125:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788652120.217319:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652120.217324:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788652120.217330:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86edd68800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788652120.217336:0:20960:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86edd68800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788652120.217345:0:20960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788652120.217507:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4e6f 00000020:00000080:0.0:1788652120.217516:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86edd6a800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788652120.217627:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86c6d44800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788652120.217636:0:38:0:(genops.c:885:class_export_put()) final put ffff8f86c6cf0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788652120.217638:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c6cf0800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788652120.217643:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788652120.218435:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:1.0:1788652120.218499:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86edd6a800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788652120.218514:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788652120.218522:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788652120.218526:0:20960:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8f86c8db3380) has no exports 00000020:00000080:1.0:1788652120.218551:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788652120.218558:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:1.0:1788652120.218562:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f85c2109800/lustre-MDD0001_UUID 00000020:00000080:1.0:1788652120.218564:0:20960:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2109800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788652120.218567:0:20960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788652120.218693:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4e76 00000020:00000080:1.0:1788652120.218699:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86eeab8000/lustre-MDT0001-osd_UUID 00000020:01000004:1.0:1788652120.218728:0:20960:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f85c3548800 from lustre-MDT0001, refs=2 00000020:01000004:1.0:1788652120.218731:0:20960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f85c3548800 2 00000020:01000004:1.0:1788652120.218734:0:20960:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f85c3548800 from lustre-MDT0001 00000020:00000080:1.0:1788652120.218753:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788652120.218757:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:1.0:1788652120.218771:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f85c210e000/lustre-MDT0001_UUID 00000020:00000080:1.0:1788652120.218773:0:20960:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c210e000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:1.0:1788652120.218781:0:20960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:1.0:1788652120.218823:0:20960:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:1.0:1788652120.218826:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:1.0:1788652120.218829:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788652120.218832:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788652120.218837:0:20960:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8f85c2ada000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788652120.218842:0:20960:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8f86c8db4d40) has exports, disconnecting them 00000020:00080000:1.0:1788652120.218845:0:20960:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8f85c2ada000), last request at 1788652033 00000020:00000080:1.0:1788652120.218849:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4ef4 00000020:00080000:1.0:1788652120.218861:0:20960:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c2ada000): rc 0 00000020:00000080:1.0:1788652120.218864:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f85c2ada000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788652120.219981:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86eeab8000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788652120.219994:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2ada000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788652120.220968:0:20960:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788652120.220974:0:20960:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788652120.220978:0:20960:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788652120.220985:0:20960:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788652120.221013:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c2add000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788652120.221220:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652120.221228:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788652120.221234:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f85c2adc000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788652120.221238:0:20960:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2adc000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788652120.221244:0:20960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788652120.221306:0:20960:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f85c3548800 1 00000020:00000080:0.0:1788652120.221312:0:20960:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4e1b 00000020:00000080:0.0:1788652120.221328:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86c803c800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788652120.221338:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788652120.221346:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c803c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788652120.221354:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788652120.221358:0:20960:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788652120.221361:0:20960:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8f86eeba8000) has no exports 00000020:00000080:0.0:1788652120.333344:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652120.333358:0:20960:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788652120.333364:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f86d11b4000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788652120.333369:0:20960:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86d11b4000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788652120.333381:0:20960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788652120.333497:0:20960:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f85c3549000 00000020:01000000:0.0:1788652120.333516:0:20960:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788652120.333519:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788652120.333523:0:20960:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788652120.333527:0:20960:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8f85c2934d40) has no exports 00000100:00100000:3.0:1788652120.334671:0:17187:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8f85c3612c00:17187] 1 exiting: rc = 0 00000100:00100000:3.0:1788652120.334823:0:19982:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8f85c369fe00:19982] 4 exiting: rc = 0 00000100:00100000:2.0:1788652120.335792:0:19248:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8f86f5604c00:19248] 3 exiting: rc = 0 00000100:00100000:1.0:1788652120.336777:0:17188:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8f85c3613a00:17188] 2 exiting: rc = 0 00000100:00100000:0.0:1788652120.337164:0:17186:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8f85c3612400:17186] 0 exiting: rc = 1 00000100:00100000:3.0:1788652120.337495:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337503:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337509:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337514:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337519:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337525:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337531:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337536:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337542:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337547:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337552:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337557:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337562:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337613:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337620:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337625:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337630:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337636:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337641:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337646:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337651:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337656:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337662:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337667:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337672:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337677:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337693:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337698:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337703:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337710:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337714:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337720:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337725:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337730:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337735:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337740:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337746:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337756:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337772:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337777:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337782:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337788:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337793:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337799:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337804:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337820:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337826:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337832:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337836:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337841:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337847:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337852:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337857:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337862:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337868:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337874:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337878:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337883:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337891:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337896:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337902:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337932:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337938:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.337944:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.344548:0:17190:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8f85c3613e00:17190] 1 exiting: rc = 0 00000100:00100000:2.0:1788652120.344782:0:17189:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8f85c3613c00:17189] 0 exiting: rc = 1 00000100:00100000:3.0:1788652120.345449:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345458:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345465:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345471:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345476:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345481:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345486:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345491:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345497:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345502:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345507:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345511:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345516:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345520:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345525:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345529:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345534:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345539:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345543:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345547:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345553:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345558:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345564:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345569:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345574:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345578:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345583:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345588:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345593:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345598:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345603:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345675:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345689:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345693:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345699:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345705:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345710:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345715:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345720:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345725:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345730:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345735:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345739:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345743:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345748:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345754:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345769:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345774:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345779:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345783:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345788:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345792:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345797:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345801:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345873:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345880:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345885:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345890:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345894:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345899:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.345904:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.346240:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.346245:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.346251:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.347089:0:18173:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8f86c3556400:18173] 2 exiting: rc = 0 00000100:00100000:2.0:1788652120.347579:0:17192:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8f85c3612a00:17192] 1 exiting: rc = 0 00000100:00100000:1.0:1788652120.348100:0:17191:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8f86ff43e800:17191] 0 exiting: rc = 1 00000100:00100000:3.0:1788652120.348200:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348210:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348216:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348232:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348238:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348244:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348250:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348255:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348272:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348279:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348296:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348302:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348308:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348314:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348320:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348326:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348331:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348337:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348343:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348349:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348354:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348360:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348378:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348384:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348390:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348396:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348402:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348408:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348413:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348419:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348424:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348430:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348436:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348440:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348458:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348464:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348470:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348475:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348485:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348491:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348497:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348502:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348509:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348516:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348523:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348529:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348546:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348554:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348560:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348566:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348572:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348578:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348583:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348589:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348595:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348601:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348614:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348620:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348638:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348644:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348650:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348656:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348663:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.348669:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652120.364754:0:17194:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8f85c3612200:17194] 1 exiting: rc = 0 00000100:00100000:1.0:1788652120.365020:0:17193:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8f85c3612000:17193] 0 exiting: rc = 1 00000100:00100000:0.0:1788652120.366793:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.366801:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.366899:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.366958:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.366967:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.366973:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.366978:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.366982:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.366987:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.366993:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.366998:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367004:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367009:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367014:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367033:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367038:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367043:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367048:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367053:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367058:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367063:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367068:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367243:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367249:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367254:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367259:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367398:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367407:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367412:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367419:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367423:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367428:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367432:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367437:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367442:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367447:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367452:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367457:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367463:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367468:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367473:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367477:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367483:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367487:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367492:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367497:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367502:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367507:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367512:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367526:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367532:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367538:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367543:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367548:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367553:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367558:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367564:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367569:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367574:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367579:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367585:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367590:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367595:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.367601:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652120.368787:0:17196:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8f85c3134800:17196] 1 exiting: rc = 0 00000100:00100000:2.0:1788652120.369453:0:17195:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8f85c2845e00:17195] 0 exiting: rc = 1 00000100:00100000:0.0:1788652120.369597:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369604:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369679:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369684:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369690:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369696:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369700:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369706:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369711:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369716:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369722:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369727:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369732:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369738:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369743:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369748:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369753:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369769:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369775:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369780:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369872:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369880:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369885:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369890:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369895:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.369900:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370406:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370416:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370422:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370428:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370433:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370439:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370444:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370450:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370456:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370462:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370468:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370474:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370479:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370485:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370491:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370496:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370502:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370508:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370514:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370519:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370524:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370530:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370535:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370540:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370546:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370551:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370557:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370562:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370567:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370583:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370588:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370594:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370599:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370604:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370688:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370694:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370699:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.370704:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.372817:0:17198:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8f85c2844200:17198] 1 exiting: rc = 0 00000100:00100000:2.0:1788652120.373446:0:17197:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8f85c2844e00:17197] 0 exiting: rc = 1 00000100:00100000:1.0:1788652120.373587:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373594:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373600:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373663:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373672:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373678:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373683:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373688:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373693:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373714:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373719:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373724:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373729:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373735:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373739:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373744:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373749:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373754:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373771:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373776:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373781:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373786:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373791:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373795:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373800:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373866:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373874:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373879:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373884:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373890:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373895:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.373900:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374020:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374027:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374032:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374037:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374042:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374441:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374448:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374453:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374458:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374463:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374467:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374472:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374486:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374492:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374496:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374501:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374506:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374511:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374516:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374521:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374526:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374531:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374536:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374541:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374546:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374551:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374556:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374561:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374566:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374571:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374576:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.374582:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652120.376736:0:17199:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8f85c3135c00:17199] 0 exiting: rc = 1 00000100:00100000:0.0:1788652120.376996:0:17201:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8f85c2097a00:17201] 2 exiting: rc = 0 00000100:00100000:3.0:1788652120.377701:0:17200:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8f85c3135600:17200] 1 exiting: rc = 0 00000100:00100000:1.0:1788652120.378040:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378048:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378054:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378060:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378066:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378071:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378077:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378082:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378088:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378093:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378099:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378105:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378110:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378117:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378122:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378140:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378265:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378272:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378278:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378295:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378302:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378307:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378313:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378318:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378324:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378330:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378336:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378342:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378348:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378353:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378359:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378364:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378370:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378376:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378382:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378387:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378393:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378399:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378406:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378412:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378419:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378426:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378433:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378453:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378460:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378465:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378471:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378476:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378482:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378488:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378501:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378507:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378512:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378518:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378523:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378530:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378541:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378548:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378554:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378560:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378565:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378571:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378576:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652120.378582:0:20960:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788652120.383384:0:20960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788652120.383403:0:20960:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788652120.383409:0:20960:0:(genops.c:885:class_export_put()) final put ffff8f85c3fbe000/MDS_uuid 00000020:00000080:1.0:1788652120.383415:0:20960:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3fbe000/MDS_uuid for MDS 00000020:01000000:1.0:1788652120.383422:0:20960:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788652120.383608:0:20960:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788652120.609080:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652121.632287:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652122.657253:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652123.680139:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788652123.987547:0:21162:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788652124.014730:0:21162:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788652124.014788:0:21162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652124.014804:0:21162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652124.014812:0:21162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652124.014819:0:21162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652124.014862:0:21162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788652124.014868:0:21162:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788652124.014895:0:21162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788652124.014899:0:21162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788652124.014924:0:21162:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788652124.014930:0:21162:0:(import.c:65:import_set_state_nolock()) ffff8f86eeab9000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788652124.014935:0:21162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788652124.014936:0:21162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788652124.014939:0:21162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788652124.015709:0:21162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788652124.015713:0:21162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788652124.015717:0:21162:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788652124.015737:0:21162:0:(import.c:65:import_set_state_nolock()) ffff8f85c1970800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788652124.016411:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652124.016420:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652124.016430:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652124.016434:0:19250:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652124.016451:0:19250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652124.016459:0:19250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652124.016465:0:19250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652124.016468:0:19250:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788652124.016471:0:19250:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788652124.016489:0:19250:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f85c3cb2000 00010000:00010000:0.0:1788652124.016493:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652124.016516:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652124.016531:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652124.016533:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652124.016535:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652124.016559:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875537147693952:0@lo:39:umount.0 00000400:00000100:0.0:1788652124.016609:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147693952 offset 0 length 224: 4 00000100:00080000:1.0:1788652124.129740:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a28e2822-101e-46fe-b9c1-7a60e90536a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788652124.129749:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a28e2822-101e-46fe-b9c1-7a60e90536a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652124.129751:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788652124.129755:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788652124.129759:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c3093800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652124.129767:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 574 00000100:00080000:1.0:1788652124.129773:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788652124.129780:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f85c3093800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652124.129834:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c348fb80 x1875537147694080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788652124.129937:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147694208:0@lo:400:kworker.0 00000400:00000100:3.0:1788652124.130000:0:3638:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147694208 offset 0 length 224: 4 00000100:00100000:0.0:1788652124.130332:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147694080:0@lo:38:kworker.0 00000400:00000100:0.0:1788652124.130357:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147694080 offset 0 length 520: 4 00010000:00010000:1.0:1788652124.704140:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652125.735511:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788652126.179484:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788652126.179493:0:18688:0:(genops.c:885:class_export_put()) final put ffff8f85c1973000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788652126.179543:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c1973000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788652126.179594:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c1977800 for lustre-OST0000 00000001:00100000:0.0:1788652126.180097:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788652126.180102:0:19510:0:(genops.c:885:class_export_put()) final put ffff8f85c3094800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788652126.180171:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3094800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788652126.180192:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3094000 for lustre-OST0001 00010000:00010000:0.0:1788652126.752286:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652127.779563:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652128.800162:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788652129.248077:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a28e2822-101e-46fe-b9c1-7a60e90536a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788652129.248087:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a28e2822-101e-46fe-b9c1-7a60e90536a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652129.248090:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788652129.248093:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788652129.248343:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788652129.248363:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147694336:0@lo:400:kworker.0 00000400:00000100:0.0:1788652129.248419:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147694336 offset 0 length 224: 4 00010000:00010000:0.0:1788652129.824247:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652130.272070:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652120/real 1788652120] req@ffff8f86efa37b80 x1875537147693824/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788652130 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652130.272107:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86efa37b80 x1875537147693824/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788652130 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788652130.272129:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3cb2000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652130.272325:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788652130.272330:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a28e2822-101e-46fe-b9c1-7a60e90536a9:3634:1875537147693824:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1788652130.273428:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) a28e2822-101e-46fe-b9c1-7a60e90536a9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788652130.273588:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788652130.273592:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f85c3cb2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652130.273598:0:8:0:(import.c:545:import_select_connection()) MGC192.168.204.145@tcp: connect to NID 0@lo last attempt 575 00000100:00080000:1.0:1788652130.273604:0:8:0:(import.c:630:import_select_connection()) MGC192.168.204.145@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788652130.273611:0:8:0:(import.c:665:import_select_connection()) MGC192.168.204.145@tcp: import ffff8f85c3cb2000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652130.273648:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c348d880 x1875537147694464/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788652130.274751:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a28e2822-101e-46fe-b9c1-7a60e90536a9:3634:1875537147694464:0@lo:250:kworker.0 00000400:00000100:0.0:1788652130.274818:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875537147694464 offset 0 length 520: 4 00000100:00080000:1.0:1788652130.274944:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788652130.274950:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788652130.275073:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147694592:0@lo:400:kworker.0 00000400:00000100:2.0:1788652130.275108:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147694592 offset 0 length 224: 4 00010000:00010000:1.0:1788652130.850058:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652131.872186:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652132.896178:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652133.921621:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652134.369317:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652124/real 1788652124] req@ffff8f85c348dc00 x1875537147693952/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788652134 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652134.369355:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f85c348dc00 x1875537147693952/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788652134 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788652134.369374:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c1970800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788652134.369475:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875537147693952:0@lo:39:umount.0 00000100:00080000:2.0:1788652134.369542:0:21162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788652134.369547:0:21162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788652134.369553:0:21162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788652134.371247:0:21162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652134.371264:0:21162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652134.371272:0:21162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652134.371297:0:21162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652134.371327:0:21162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652134.371335:0:21162:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652134.371341:0:21162:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652134.371347:0:21162:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652134.371353:0:21162:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652134.371437:0:21162:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788652134.371442:0:21162:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788652134.371470:0:21162:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788652134.371474:0:21162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788652134.371478:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652134.371484:0:21162:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788652134.371497:0:21162:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8f85c3d33380) has no exports 00000020:00080000:2.0:1788652134.371524:0:21162:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8f85c3d33380) has no exports 00010000:00010000:1.0:1788652134.373656:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652134.373669:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652134.373680:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652134.373685:0:19250:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652134.373695:0:19250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652134.373703:0:19250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652134.373708:0:19250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788652134.373711:0:19250:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1788652134.373714:0:19250:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1788652134.373732:0:19250:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f85c3cb2000 00010000:00010000:1.0:1788652134.373737:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652134.373744:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652134.373760:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652134.373764:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652134.373770:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652134.373789:0:19250:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652134.373796:0:19250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652134.373802:0:19250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652134.373808:0:19250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788652134.373810:0:19250:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788652134.373812:0:19250:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788652134.373818:0:19250:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f85c3cb2000 00010000:00010000:1.0:1788652134.373821:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652134.373826:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652134.373835:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652134.373837:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652134.373839:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652134.374560:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788652134.374608:0:21162:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86ee8c1e40 - data ffff8f86f85a1d80/ffff8f86c3442000 00000020:01000000:2.0:1788652134.374880:0:21162:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86f48c97e0 - data ffff8f86f8418af8/ffff8f86fdf70800 00100000:10000000:2.0:1788652134.387860:0:21162:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788652134.403726:0:21162:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4f79 00000020:00000080:0.0:1788652134.403739:0:21162:0:(genops.c:885:class_export_put()) final put ffff8f85c32cc000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788652134.403759:0:21162:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86c6e8c000 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788652134.403763:0:21162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86c6e8c000 2 00000020:01000004:0.0:1788652134.403765:0:21162:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f86c6e8c000 from lustre-OST0000 00000020:00000080:0.0:1788652134.403791:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652134.403808:0:21162:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788652134.403811:0:21162:0:(genops.c:885:class_export_put()) final put ffff8f86c6cf1800/lustre-OST0000_UUID 00000020:00000080:0.0:1788652134.403814:0:21162:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c6cf1800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788652134.403821:0:21162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788652134.403878:0:21162:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788652134.403883:0:21162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788652134.403887:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788652134.403891:0:21162:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788652134.403898:0:21162:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8f85c1971000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788652134.403904:0:21162:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8f86c8db0000) has exports, disconnecting them 00000020:00080000:0.0:1788652134.404042:0:21162:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8f85c1971000), last request at 1788652051 00000020:00000080:0.0:1788652134.404047:0:21162:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4fa3 00000020:00080000:0.0:1788652134.404128:0:21162:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c1971000): rc 0 00000020:00000080:0.0:1788652134.404134:0:21162:0:(genops.c:885:class_export_put()) final put ffff8f85c1971000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788652134.405289:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32cc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788652134.405310:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c1971000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788652134.405339:0:21162:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788652134.405344:0:21162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788652134.405349:0:21162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788652134.405355:0:21162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788652134.405577:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788652134.405585:0:21162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788652134.405592:0:21162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788652134.405607:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788652134.405612:0:21162:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788652134.405618:0:21162:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8f85c1975000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788652134.405636:0:21162:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8f86f560cd40) has exports, disconnecting them 00000020:00080000:1.0:1788652134.405641:0:21162:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8f85c1975000), last request at 1788652051 00000020:00000080:1.0:1788652134.405645:0:21162:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4fb8 00000020:00080000:1.0:1788652134.405659:0:21162:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c1975000): rc 0 00000020:00000080:1.0:1788652134.405664:0:21162:0:(genops.c:885:class_export_put()) final put ffff8f85c1975000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788652134.405897:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86eeab9000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788652134.405904:0:8:0:(genops.c:885:class_export_put()) final put ffff8f86ea139800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788652134.405928:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea139800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788652134.405945:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788652134.406005:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c1975000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788652134.413347:0:21162:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788652134.413356:0:21162:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788652134.413360:0:21162:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788652134.413368:0:21162:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788652134.413394:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c1970800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788652134.413609:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788652134.413617:0:21162:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:3.0:1788652134.413623:0:21162:0:(genops.c:885:class_export_put()) final put ffff8f85c1973800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:3.0:1788652134.413626:0:21162:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c1973800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:3.0:1788652134.413632:0:21162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:3.0:1788652134.413697:0:21162:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86c6e8c000 1 00000020:00000080:3.0:1788652134.413703:0:21162:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4f56 00000020:00000080:3.0:1788652134.413710:0:21162:0:(genops.c:885:class_export_put()) final put ffff8f86edd6c000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788652134.413720:0:21162:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788652134.413729:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86edd6c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788652134.413737:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788652134.413741:0:21162:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788652134.413745:0:21162:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8f86c8db19c0) has no exports 00000020:00000080:3.0:1788652134.445778:0:21162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788652134.445799:0:21162:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788652134.445814:0:21162:0:(genops.c:885:class_export_put()) final put ffff8f85c2ada800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788652134.445822:0:21162:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2ada800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788652134.445832:0:21162:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788652134.445963:0:21162:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f86c6e8d000 00000020:02000400:3.0:1788652134.446012:0:21162:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788652134.945035:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788652135.394492:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a28e2822-101e-46fe-b9c1-7a60e90536a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788652135.394501:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) a28e2822-101e-46fe-b9c1-7a60e90536a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652135.394504:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788652135.394507:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788652135.401819:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147694720:0@lo:400:kworker.0 00000400:00000100:2.0:1788652135.401888:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147694720 offset 0 length 224: 4 00010000:00010000:0.0:1788652135.969129:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652136.993520:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652138.016966:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788652138.179303:0:21364:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788652138.194176:0:21364:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788652138.194272:0:21364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.194289:0:21364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.194297:0:21364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.194304:0:21364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652138.194328:0:21364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788652138.194334:0:21364:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788652138.194358:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788652138.194370:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f85c348fb80 x1875537147694080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788652144 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652138.194444:0:21364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788652138.194451:0:21364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788652138.194457:0:21364:0:(import.c:65:import_set_state_nolock()) ffff8f85c3093800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788652138.194462:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788652138.194465:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f85c348fb80 x1875537147694080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788652144 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788652138.194500:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652138.194507:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.194514:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f8000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652138.194518:0:19250:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.194527:0:19250:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652138.194533:0:19250:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652138.194539:0:19250:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652138.194542:0:19250:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788652138.194544:0:19250:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788652138.194557:0:19250:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f85c3cb2000 00010000:00010000:0.0:1788652138.194561:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.194567:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652138.194579:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652138.194581:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652138.194582:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652138.197473:0:21364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788652138.200647:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147694080:0@lo:38:kworker.0 00000100:00100000:2.0:1788652138.202473:0:21364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788652138.209780:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788652138.209801:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f85c348c700 x1875537147694208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652140 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652138.209898:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f85c348d180 x1875537147694336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652145 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652138.209938:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f85c348df80 x1875537147694592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652146 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652138.209956:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f85c348dc00 x1875537147694720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652151 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652138.209976:0:21364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788652138.209983:0:21364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788652138.210013:0:21364:0:(import.c:65:import_set_state_nolock()) ffff8f85c32ca000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788652138.210035:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147694592:0@lo:400:kworker.0 00000100:00100000:2.0:1788652138.210060:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147694336:0@lo:400:kworker.0 00000100:00100000:0.0:1788652138.210234:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147694720:0@lo:400:kworker.0 00000100:00100000:0.0:1788652138.210274:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875537147694848:0@lo:39:umount.0 00000400:00000100:0.0:1788652138.210332:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147694848 offset 0 length 224: 4 00000100:00100000:1.0:1788652138.210833:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147694208:0@lo:400:kworker.0 00010000:00010000:0.0:1788652139.040187:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652140.065044:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788652140.512036:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) a28e2822-101e-46fe-b9c1-7a60e90536a9->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788652140.512047:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) a28e2822-101e-46fe-b9c1-7a60e90536a9->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788652141.088107:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652142.118973:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652143.136151:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652144.162678:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652145.184725:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652145.376352:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652130/real 1788652130] req@ffff8f85c348d880 x1875537147694464/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788652145 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652145.376388:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f85c348d880 x1875537147694464/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788652145 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788652145.376408:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3cb2000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652145.376444:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788652145.376449:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a28e2822-101e-46fe-b9c1-7a60e90536a9:3634:1875537147694464:0@lo:250:kworker.0 00000100:00080000:2.0:1788652145.376562:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) a28e2822-101e-46fe-b9c1-7a60e90536a9->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788652145.376568:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788652145.376571:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c3cb2000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788652145.376576:0:38:0:(import.c:545:import_select_connection()) MGC192.168.204.145@tcp: connect to NID 0@lo last attempt 586 00000100:00080000:2.0:1788652145.376581:0:38:0:(import.c:630:import_select_connection()) MGC192.168.204.145@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788652145.376588:0:38:0:(import.c:665:import_select_connection()) MGC192.168.204.145@tcp: import ffff8f85c3cb2000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652145.376685:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f67af800 x1875537147694976/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652145.376737:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a28e2822-101e-46fe-b9c1-7a60e90536a9:3634:1875537147694976:0@lo:250:kworker.0 00000400:00000100:1.0:1788652145.376781:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875537147694976 offset 0 length 520: 4 00010000:00010000:0.0:1788652146.213179:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652147.232150:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652148.256272:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652148.448825:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652138/real 1788652138] req@ffff8f86ff5d8380 x1875537147694848/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788652148 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652148.448864:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86ff5d8380 x1875537147694848/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788652148 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788652148.448885:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c32ca000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788652148.448924:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875537147694848:0@lo:39:umount.0 00000100:00080000:3.0:1788652148.449050:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788652148.449055:0:21364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788652148.449061:0:21364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788652148.450120:0:21364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652148.450135:0:21364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652148.450143:0:21364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652148.450150:0:21364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652148.450239:0:21364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652148.450247:0:21364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652148.450274:0:21364:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652148.450281:0:21364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652148.450287:0:21364:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652148.451838:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652148.451851:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652148.451862:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652148.451866:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652148.451875:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652148.451883:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652148.451888:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788652148.451891:0:17175:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788652148.451904:0:17175:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f85c3cb2000 00010000:00010000:0.0:1788652148.451921:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652148.451929:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652148.451961:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652148.451965:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652148.451970:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652148.451988:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652148.451995:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652148.452000:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652148.452005:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788652148.452007:0:17175:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788652148.452012:0:17175:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f85c3cb2000 00010000:00010000:0.0:1788652148.452014:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652148.452021:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652148.452022:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652148.452024:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652148.452430:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652148.452460:0:21364:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788652148.452468:0:21364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652148.452485:0:21364:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1788652148.452491:0:21364:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788652148.452493:0:21364:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788652148.452525:0:21364:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788652148.452529:0:21364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788652148.452536:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788652148.452541:0:21364:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788652148.452545:0:21364:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8f85c20fb380) has no exports 00000020:00080000:3.0:1788652148.452635:0:21364:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8f85c20fb380) has no exports 00000020:01000000:3.0:1788652148.455894:0:21364:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86ee8c1480 - data ffff8f86f86ff948/ffff8f86c3440400 00000020:01000000:3.0:1788652148.456089:0:21364:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86ee8c1a80 - data ffff8f86f865d510/ffff8f86f3d3f400 00100000:10000000:3.0:1788652148.467513:0:21364:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788652148.483612:0:21364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c50de 00000020:00000080:1.0:1788652148.483624:0:21364:0:(genops.c:885:class_export_put()) final put ffff8f85c3e6a000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788652148.483646:0:21364:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86f3cfe800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788652148.483650:0:21364:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86f3cfe800 2 00000020:01000004:1.0:1788652148.483653:0:21364:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f86f3cfe800 from lustre-OST0001 00000020:00000080:1.0:1788652148.483678:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788652148.483687:0:21364:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788652148.483690:0:21364:0:(genops.c:885:class_export_put()) final put ffff8f85c3e69800/lustre-OST0001_UUID 00000020:00000080:1.0:1788652148.483693:0:21364:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3e69800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788652148.483699:0:21364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788652148.483777:0:21364:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a28e2822-101e-46fe-b9c1-7a60e90536a9->MGS 00010000:00010000:1.0:1788652148.483793:0:21364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f0907a00/0xcd2f56ea038c4e22 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c4e29 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652148.483805:0:21364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0907a00/0xcd2f56ea038c4e22 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c4e29 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652148.483812:0:21364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788652148.483815:0:21364:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788652148.483828:0:21364:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788652148.483845:0:21364:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f85c3cb2000 00010000:00010000:1.0:1788652148.483849:0:21364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f0907a00/0xcd2f56ea038c4e22 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c4e29 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652148.483864:0:21364:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652148.483872:0:21364:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652148.483877:0:21364:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788652148.483880:0:21364:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788652148.483882:0:21364:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788652148.483889:0:21364:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f85c3cb2000 00010000:00010000:1.0:1788652148.483892:0:21364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788652148.483937:0:21364:0:(import.c:65:import_set_state_nolock()) ffff8f85c3cb2000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788652148.483941:0:21364:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788652148.483943:0:21364:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788652148.483945:0:21364:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788652148.483949:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788652148.483959:0:21364:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f67af800 x1875537147694976/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788652165 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788652148.483975:0:21364:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788652148.483978:0:21364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:2.0:1788652148.484055:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a28e2822-101e-46fe-b9c1-7a60e90536a9:3634:1875537147694976:0@lo:250:kworker.0 10000000:01000000:1.0:1788652148.484184:0:21364:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788652148.484190:0:21364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c4cfc 00000020:00000080:1.0:1788652148.484194:0:21364:0:(genops.c:885:class_export_put()) final put ffff8f85c3fba800/a28e2822-101e-46fe-b9c1-7a60e90536a9 00000020:01000000:1.0:1788652148.484199:0:21364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.145@tcp (flags='') 00000020:00000080:1.0:1788652148.484204:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788652148.484213:0:21364:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.145@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788652148.484225:0:21364:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8f85c2ae4d40) has no exports 10000000:01000000:2.0:1788652148.484287:0:17184:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788652148.484501:0:21364:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.145@tcp: client import never connected 00000100:00080000:1.0:1788652148.484504:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788652148.484506:0:21364:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788652148.484509:0:21364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788652148.484511:0:21364:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788652148.484541:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788652148.484546:0:21364:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.145@tcp (uuid a28e2822-101e-46fe-b9c1-7a60e90536a9) 00000020:01000000:1.0:1788652148.484550:0:21364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788652148.484554:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788652148.484557:0:21364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788652148.484561:0:21364:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8f85c3095000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788652148.484567:0:21364:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8f85c217b380) has exports, disconnecting them 00000020:00080000:1.0:1788652148.484571:0:21364:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8f85c3095000), last request at 1788652067 00000020:00000080:1.0:1788652148.484575:0:21364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c5108 00000020:00080000:1.0:1788652148.484584:0:21364:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c3095000): rc 0 00000020:00000080:1.0:1788652148.484588:0:21364:0:(genops.c:885:class_export_put()) final put ffff8f85c3095000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788652148.485512:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3e6a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788652148.485525:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3fba800/a28e2822-101e-46fe-b9c1-7a60e90536a9 for MGC192.168.204.145@tcp 00000020:00000080:0.0:1788652148.485531:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3cb2000 for MGC192.168.204.145@tcp 00000020:00000080:0.0:1788652148.485537:0:38:0:(genops.c:885:class_export_put()) final put ffff8f85c3cb7000/a28e2822-101e-46fe-b9c1-7a60e90536a9 00000020:00000080:0.0:1788652148.485548:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3cb7000/a28e2822-101e-46fe-b9c1-7a60e90536a9 for MGC192.168.204.145@tcp 00000020:01000000:0.0:1788652148.485552:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.145@tcp (a28e2822-101e-46fe-b9c1-7a60e90536a9) 00000020:00000080:0.0:1788652148.485798:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3095000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788652148.485823:0:21364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788652148.485826:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788652148.485830:0:21364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788652148.485834:0:21364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788652148.486001:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652148.486009:0:21364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788652148.486014:0:21364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788652148.486018:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788652148.486021:0:21364:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788652148.486026:0:21364:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8f85c32ca800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788652148.486031:0:21364:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8f85c3d30000) has exports, disconnecting them 00000020:00080000:0.0:1788652148.486035:0:21364:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8f85c32ca800), last request at 1788652067 00000020:00000080:0.0:1788652148.486039:0:21364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c511d 00000020:00080000:0.0:1788652148.486050:0:21364:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c32ca800): rc 0 00000020:00000080:0.0:1788652148.486054:0:21364:0:(genops.c:885:class_export_put()) final put ffff8f85c32ca800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788652148.486833:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3093800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788652148.486841:0:38:0:(genops.c:885:class_export_put()) final put ffff8f86f3cfa800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788652148.486844:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f3cfa800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788652148.486858:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788652148.486927:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32ca800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788652148.501978:0:21364:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788652148.501989:0:21364:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788652148.501993:0:21364:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788652148.502002:0:21364:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788652148.502045:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c32ca000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788652148.502454:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788652148.502588:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788652148.506009:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788652148.506183:0:17171:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8f86ee931400:17171] 1 exiting: rc = 0 00000100:00100000:2.0:1788652148.506289:0:17170:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8f86ee930a00:17170] 0 exiting: rc = 1 00000100:00100000:2.0:1788652148.506342:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.508017:0:17172:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8f86ee931c00:17172] 0 exiting: rc = 1 00000100:00100000:2.0:1788652148.508019:0:18719:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8f85c369e200:18719] 3 exiting: rc = 0 00000100:00100000:0.0:1788652148.508106:0:17173:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8f86ee930200:17173] 1 exiting: rc = 0 00000100:00100000:1.0:1788652148.537591:0:17174:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8f86ee931600:17174] 2 exiting: rc = 0 00000100:00100000:2.0:1788652148.537713:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537723:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537729:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537735:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537742:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537748:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537755:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537761:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537766:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537771:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537776:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537781:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537786:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537791:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537808:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537815:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537820:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537825:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537829:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537835:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537840:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537844:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537850:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537856:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537861:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537867:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537872:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537879:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537885:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537890:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537894:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537900:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537905:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537941:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537963:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537968:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537973:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537978:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537983:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537989:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.537995:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538000:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538005:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538009:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538014:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538018:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538022:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538027:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538032:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538037:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538042:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538047:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538053:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538059:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538065:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538070:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538075:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538080:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538085:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538090:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538096:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538101:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538106:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.538112:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788652148.539999:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788652148.540011:0:21364:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788652148.540017:0:21364:0:(genops.c:885:class_export_put()) final put ffff8f85c32ce000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788652148.540022:0:21364:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32ce000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788652148.540034:0:21364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788652148.540100:0:21364:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86f3cfe800 1 00000020:00000080:2.0:1788652148.540106:0:21364:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c50c2 00000020:00000080:2.0:1788652148.540111:0:21364:0:(genops.c:885:class_export_put()) final put ffff8f86ea13c800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788652148.540136:0:21364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788652148.540140:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788652148.540144:0:21364:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788652148.540148:0:21364:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8f85c217cd40) has no exports 00000020:00000080:1.0:1788652148.540676:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea13c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788652148.583367:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652148.583381:0:21364:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788652148.583386:0:21364:0:(genops.c:885:class_export_put()) final put ffff8f86f3cfb800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788652148.583390:0:21364:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f3cfb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788652148.583402:0:21364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788652148.583783:0:21364:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f86f3cf8800 00000020:01000000:0.0:1788652148.583818:0:21364:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788652148.583824:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788652148.583831:0:21364:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788652148.583836:0:21364:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8f85c2930000) has no exports 00000020:00000080:0.0:1788652148.583861:0:21364:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788652148.583867:0:21364:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788652148.583870:0:21364:0:(genops.c:885:class_export_put()) final put ffff8f86edd69800/OSS_uuid 00000020:00000080:0.0:1788652148.583872:0:21364:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86edd69800/OSS_uuid for OSS 00000020:01000000:0.0:1788652148.583876:0:21364:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788652148.584079:0:18694:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8f85c3125000:18694] 2 exiting: rc = 0 00000100:00100000:1.0:1788652148.584124:0:18693:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8f86f4a4b400:18693] 1 exiting: rc = 0 00000100:00100000:2.0:1788652148.584398:0:18692:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8f85c3125e00:18692] 0 exiting: rc = 1 00000100:00100000:2.0:1788652148.584449:0:19081:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8f85c3df3a00:19081] 3 exiting: rc = 0 00000100:00100000:0.0:1788652148.584553:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584561:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584567:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584573:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584578:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584583:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584589:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584594:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584600:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584605:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584609:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584615:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584654:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584661:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584667:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584672:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584678:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584683:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584688:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584694:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584700:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584705:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584710:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584715:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584720:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584736:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584741:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584746:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584752:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584756:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584761:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584766:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584771:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584776:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584781:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584787:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584792:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584797:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584803:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584808:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584813:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584818:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584823:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584828:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584834:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584840:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584845:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584851:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584856:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584861:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584866:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584872:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584877:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584883:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584888:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584894:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584899:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.584904:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.585210:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.585226:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.585240:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.585245:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.585250:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.585260:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:3.0:1788652148.586271:0:17183:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788652148.586516:0:18696:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8f86da43fe00:18696] 1 exiting: rc = 0 00000100:00100000:0.0:1788652148.586621:0:18695:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8f86da43fc00:18695] 0 exiting: rc = 1 00000100:00100000:3.0:1788652148.586724:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586730:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586735:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586752:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586757:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586762:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586768:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586773:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586778:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586783:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586789:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586793:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586798:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586803:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586808:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586813:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586818:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586823:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586828:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586834:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586839:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586844:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586849:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586854:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586859:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586863:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586868:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586873:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586878:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586884:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586889:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586895:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.586900:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587179:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587188:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587194:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587198:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587204:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587226:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587231:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587236:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587240:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587245:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587249:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587254:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587259:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587264:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587270:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587274:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587278:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587283:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587288:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587293:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587297:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587302:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587306:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587311:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587316:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587320:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587324:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587329:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587333:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587338:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.587342:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788652148.588677:0:18698:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8f86c3405200:18698] 1 exiting: rc = 0 00000100:00100000:1.0:1788652148.588896:0:18699:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8f85c3dbfa00:18699] 2 exiting: rc = 0 00000100:00100000:0.0:1788652148.589677:0:18697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8f86c3405000:18697] 0 exiting: rc = 1 00000100:00100000:3.0:1788652148.591382:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591392:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591397:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591402:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591407:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591413:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591420:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591426:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591432:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591456:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591462:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591468:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591473:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591479:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591485:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591491:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591498:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591515:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591522:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591529:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591535:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591540:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591546:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591552:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591557:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591563:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591568:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591573:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591578:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591584:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591590:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591597:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591603:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591609:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591615:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591622:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591627:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591633:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591639:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591644:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591650:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591670:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591677:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591682:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591694:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591700:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591706:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591712:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591719:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591724:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591729:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591735:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591741:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591746:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591751:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591757:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591762:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591768:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591774:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591779:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591785:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591790:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591796:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.591802:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788652148.596298:0:18700:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8f85c1a38800:18700] 0 exiting: rc = 1 00000100:00100000:0.0:1788652148.598900:0:18701:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8f85c3dbf800:18701] 1 exiting: rc = 0 00000100:00100000:3.0:1788652148.599346:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599353:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599363:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599369:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599375:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599380:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599385:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599390:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599395:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599400:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599405:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599410:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599415:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599419:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599424:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599437:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599441:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599446:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599451:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599456:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599461:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599466:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599471:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599476:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599481:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599486:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599490:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599495:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599500:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599505:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599510:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599515:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599520:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599525:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599531:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599536:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599540:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599545:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599550:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599555:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599560:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599565:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599570:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599575:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599579:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599584:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599589:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599594:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599599:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599604:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599618:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599623:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599628:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599633:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599638:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599643:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599648:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599654:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599659:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599664:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599670:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599675:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599680:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.599685:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788652148.600952:0:18702:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8f85c3dbea00:18702] 0 exiting: rc = 1 00000100:00100000:1.0:1788652148.601298:0:18703:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8f85c3dbf400:18703] 1 exiting: rc = 0 00000100:00100000:3.0:1788652148.601397:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601406:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601412:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601418:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601424:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601431:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601438:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601444:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601450:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601474:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601481:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601486:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601492:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601497:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601504:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601509:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601516:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601522:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601528:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601534:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601540:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601572:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601580:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601586:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601593:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601599:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601604:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601610:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601616:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601622:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601628:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601634:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601640:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601661:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601668:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601674:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601679:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601685:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601692:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601698:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601705:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601712:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601719:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601725:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601732:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601751:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601758:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601764:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601771:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601777:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601784:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601789:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601795:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601800:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601806:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601812:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601823:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601839:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601846:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601852:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601857:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601863:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601869:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788652148.601880:0:21364:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788652148.612538:0:21364:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788652171.688394:0:22130:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788652181.726536:0:22729:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788652181.726545:0:22729:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788652181.726546:0:22729:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788652181.726686:0:22729:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f86f3c9f800 00000020:01000004:2.0:1788652181.726703:0:22729:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788652181.726710:0:22729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788652181.726722:0:22729:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8f86f56099c0) 00000020:00000080:2.0:1788652181.726736:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788652181.838185:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788652181.844143:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.846030:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788652181.848601:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.849832:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.850149:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.850604:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.850817:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.851624:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.852005:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.852242:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.853924:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.854752:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.856733:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.857595:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.858296:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.858581:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.858896:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.859496:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.859861:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.860291:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.868016:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788652181.869481:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788652181.870530:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788652181.871201:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788652181.871721:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.872311:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.872880:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.875477:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.875966:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.876453:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.876851:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.878086:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.878326:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788652181.878599:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788652181.879619:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788652181.880173:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788652181.880411:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788652181.880866:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788652181.881564:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788652181.882056:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788652181.882592:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788652181.883685:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788652181.884060:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788652181.884646:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788652181.884895:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788652181.885182:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788652181.886948:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788652181.887403:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788652181.888138:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788652181.888745:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788652181.889731:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1788652181.891448:0:22729:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:0.0:1788652181.892102:0:22729:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788652181.892328:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788652181.892336:0:22729:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788652181.892347:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c5602 00000020:01000004:0.0:1788652181.892355:0:22729:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788652181.892359:0:22729:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788652181.892365:0:22729:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f86f3c9f800 from MGS 00000020:01000004:0.0:1788652181.892368:0:22729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788652181.892377:0:22729:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8f85c3d33380) 00000020:00000080:0.0:1788652181.892387:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788652181.892821:0:22729:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86f3c9f800 from MGS, refs=2 00080000:01000000:0.0:1788652181.892828:0:22729:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788652181.892834:0:22729:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c5610 00000100:00100000:0.0:1788652181.893122:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788652181.893274:0:22729:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788652181.893280:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788652181.896815:0:22729:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788652181.896831:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788652181.897568:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652181.897759:0:22729:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788652181.897765:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788652181.899266:0:22729:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788652181.899334:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788652181.899970:0:22729:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788652181.899978:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788652181.901012:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652181.901016:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652181.901018:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652181.901707:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652181.901710:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652181.901712:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652181.902727:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788652181.904824:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788652181.911032:0:22729:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788652181.913384:0:22741:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788652181.913482:0:22729:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788652181.913539:0:22729:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788652181.914477:0:22729:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788652181.914880:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788652181.916128:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788652181.916136:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788652181.917357:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788652181.917369:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788652181.923698:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788652181.923714:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788652181.928825:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788652181.928851:0:22729:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.145@tcp' 00000020:01000004:1.0:1788652181.928853:0:22729:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788652181.928883:0:22729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.145@tcp (typ=mgc) 00000020:00000080:1.0:1788652181.928895:0:22729:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.145@tcp (ffff8f85c20fb380) 00000020:00000080:1.0:1788652181.928938:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788652181.929016:0:22729:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f86c3596800@MGC192.168.204.145@tcp: add connection 192.168.204.145@tcp at head 00010000:00010000:1.0:1788652181.929153:0:22729:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.145@tcp-0 is initialized 00000040:01000000:1.0:1788652181.929159:0:22729:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788652181.931142:0:22746:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788652181.938988:0:22748:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788652181.939057:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.145@tcp (uuid f967659c-eb6d-423b-8189-3d2637ee2451) 00000020:00000080:3.0:1788652181.939083:0:22729:0:(genops.c:1385:class_connect()) connect: client f967659c-eb6d-423b-8189-3d2637ee2451, cookie 0xcd2f56ea038c561e 00000100:00080000:3.0:1788652181.939096:0:22729:0:(import.c:545:import_select_connection()) MGC192.168.204.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788652181.939104:0:22729:0:(import.c:665:import_select_connection()) MGC192.168.204.145@tcp: import ffff8f86c3596800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652181.939139:0:22729:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff5d8e00 x1875537147695104/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652181.939162:0:22729:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f967659c-eb6d-423b-8189-3d2637ee2451->MGS 00000020:01000004:3.0:1788652181.939177:0:22729:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788652181.939182:0:22729:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788652181.939194:0:22729:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8f85c2178000) 00000020:00000080:3.0:1788652181.939207:0:22729:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788652181.941620:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f967659c-eb6d-423b-8189-3d2637ee2451:3634:1875537147695104:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788652181.941690:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652181.944929:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147695104 00000100:00100000:1.0:1788652181.944944:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147695104 00000100:00100000:1.0:1788652181.944986:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652181.944995:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c239f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3634:x1875537147695104:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788652181.945024:0:22743:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f967659c-eb6d-423b-8189-3d2637ee2451@0@lo t0 exp 0000000000000000 cur 637 last 0 00000020:00000080:1.0:1788652181.945057:0:22743:0:(genops.c:1385:class_connect()) connect: client f967659c-eb6d-423b-8189-3d2637ee2451, cookie 0xcd2f56ea038c562c 00000100:00080000:1.0:1788652181.945184:0:22743:0:(import.c:65:import_set_state_nolock()) ffff8f86c3590800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652181.945274:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c239f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+5:3634:x1875537147695104:12345-0@lo:250:mount.lustre.0 Request processed in 279us (3583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652181.945282:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652181.945320:0:3634:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788652181.945328:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.145@tcp: connect to target with instance 0 00000100:00080000:1.0:1788652181.945335:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788652181.945340:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788652181.945344:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c3596800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788652181.945346:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788652181.945357:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788652181.945361:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f967659c-eb6d-423b-8189-3d2637ee2451:3634:1875537147695104:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788652181.961833:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652181.962399:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788652181.962405:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788652181.964242:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788652181.964253:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788652181.965275:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788652181.965285:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788652181.968840:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652181.969068:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788652181.969075:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788652181.969632:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788652181.969639:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788652182.004104:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788652182.004321:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788652182.004328:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788652182.010312:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788652182.010457:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788652182.011111:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652182.011286:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788652182.011292:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788652182.012271:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788652182.012279:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788652182.012774:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652182.013372:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788652182.013379:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788652182.021245:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788652182.021360:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788652182.021964:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788652182.022152:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788652182.022157:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788652182.023021:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788652182.023028:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788652182.062839:0:22729:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788652182.063324:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788652182.063332:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788652182.065364:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788652182.065377:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788652182.066730:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788652182.066741:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788652182.067806:0:22729:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788652182.067833:0:22729:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788652182.067839:0:22729:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788652182.068466:0:22729:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788652182.068509:0:22729:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.145@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788652182.068513:0:22729:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788652182.068515:0:22729:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788652182.068516:0:22729:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652182.068518:0:22729:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652182.068519:0:22729:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652182.068520:0:22729:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652182.068522:0:22729:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788652182.068523:0:22729:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788652182.068525:0:22729:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652182.068526:0:22729:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788652182.068529:0:22729:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788652182.068531:0:22729:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788652182.068532:0:22729:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788652182.068533:0:22729:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652182.068534:0:22729:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652182.068535:0:22729:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652182.068537:0:22729:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652182.068538:0:22729:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788652182.068539:0:22729:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788652182.068540:0:22729:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652182.068541:0:22729:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788652182.068578:0:22729:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788652182.068600:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147695232:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788652182.068682:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.068765:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c81056c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.068808:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147695232 00000100:00100000:0.0:1788652182.068816:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147695232 00000100:00100000:0.0:1788652182.069049:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652182.069062:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+5:22729:x1875537147695232:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788652182.069170:0:22745:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788652182.069174:0:22745:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788652182.069177:0:22745:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788652182.069714:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788652182.070397:0:22745:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1788652182.071704:0:22767:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788652182.071709:0:22767:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788652182.071713:0:22767:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788652182.071716:0:22767:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788652182.072059:0:22767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788652182.072374:0:22745:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788652182.072385:0:22745:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788652182.077957:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+5:22729:x1875537147695232:12345-0@lo:253:mount.lustre.0 Request processed in 8891us (9266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652182.077977:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652182.078100:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147695232:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788652182.078117:0:22729:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788652182.078120:0:22729:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788652182.078122:0:22729:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788652182.078124:0:22729:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652182.078125:0:22729:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652182.078126:0:22729:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652182.078127:0:22729:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652182.078129:0:22729:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788652182.078130:0:22729:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788652182.078132:0:22729:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652182.078133:0:22729:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788652182.078152:0:22729:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f86f3c9f800 from lustre-MDT0000 10000000:01000000:3.0:1788652182.078182:0:22729:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788652182.078185:0:22729:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788652182.078190:0:22729:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f85c20fb380 10000000:01000000:3.0:1788652182.078194:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788652182.078201:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f85c20fb380 from 1 10000000:01000000:3.0:1788652182.078204:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788652182.078238:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.078248:0:22729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.078258:0:22729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652182.078276:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147695360:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652182.078310:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652182.078337:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3e7c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.078643:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147695360 00000100:00100000:0.0:1788652182.078651:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147695360 00000100:00100000:0.0:1788652182.078695:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788652182.078705:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+5:22729:x1875537147695360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652182.078728:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652182.078743:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c563a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5633 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652182.078766:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c563a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5633 expref: 6 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652182.078777:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c563a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5633 expref: 6 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652182.078786:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5400, rc 0) 00000100:00100000:0.0:1788652182.078828:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+6:22729:x1875537147695360:12345-0@lo:101:mount.lustre.0 Request processed in 124us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652182.078834:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652182.078939:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147695360:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652182.078953:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.078962:0:22729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652182.079026:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147695488:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652182.079052:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652182.079069:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3e7c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788652182.079128:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147695488 00000100:00100000:1.0:1788652182.079132:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147695488 00000100:00100000:1.0:1788652182.079164:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652182.079172:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+6:22729:x1875537147695488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652182.079250:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+6:22729:x1875537147695488:12345-0@lo:501:mount.lustre.0 Request processed in 79us (197us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788652182.079257:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652182.079385:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147695488:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788652182.079412:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788652182.079429:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.079437:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652182.079444:0:22729:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f86f3c9f800 10000000:01000000:3.0:1788652182.079448:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788652182.079451:0:22729:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f86f3c9f800 10000000:01000000:3.0:1788652182.079454:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788652182.079457:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f86f3c9f800 from 1 10000000:01000000:3.0:1788652182.079459:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788652182.079475:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c5641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.079483:0:22729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c5641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.079498:0:22729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c5641 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652182.079511:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147695616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652182.079536:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652182.079556:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3e7c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788652182.079625:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147695616 00000100:00100000:2.0:1788652182.079630:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147695616 00000100:00100000:2.0:1788652182.079652:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788652182.079658:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+6:22729:x1875537147695616:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652182.079666:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652182.079677:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c5648 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5641 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.079692:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c5648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5641 expref: 7 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.079700:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c5648 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5641 expref: 7 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.079707:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0031800, rc 0) 00000100:00100000:2.0:1788652182.079745:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+7:22729:x1875537147695616:12345-0@lo:101:mount.lustre.0 Request processed in 88us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652182.079751:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652182.079928:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147695616:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652182.079940:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c5641 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5648 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.079947:0:22729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c5641 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5648 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652182.079958:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788652182.079972:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c5641 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5648 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.079980:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c5641 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5648 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652182.079986:0:22729:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788652182.079990:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788652182.079994:0:22729:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f86f3c9f800 10000000:01000000:3.0:1788652182.079996:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788652182.079999:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788652182.080000:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788652182.080014:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c564f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.080026:0:22729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c564f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.080034:0:22729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c564f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652182.080047:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147695744:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652182.080073:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652182.080089:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3e7c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788652182.080223:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147695744 00000100:00100000:2.0:1788652182.080228:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147695744 00000100:00100000:2.0:1788652182.080257:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652182.080263:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+7:22729:x1875537147695744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652182.080269:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652182.080276:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c5656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c564f expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.080289:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c5656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c564f expref: 8 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.080296:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c5656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c564f expref: 8 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.080302:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0031200, rc 0) 00000100:00100000:2.0:1788652182.080337:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+8:22729:x1875537147695744:12345-0@lo:101:mount.lustre.0 Request processed in 74us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652182.080342:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788652182.080432:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147695744:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652182.080442:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c564f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5656 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.080449:0:22729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c564f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5656 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652182.080484:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147695872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652182.080505:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652182.080528:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3e7c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788652182.080582:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147695872 00000100:00100000:1.0:1788652182.080586:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147695872 00000100:00100000:1.0:1788652182.080615:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652182.080621:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+8:22729:x1875537147695872:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652182.080743:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+9:22729:x1875537147695872:12345-0@lo:501:mount.lustre.0 Request processed in 121us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652182.080749:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788652182.080838:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147695872:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652182.080863:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147696000:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652182.081051:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652182.081069:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3e7c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.081126:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147696000 00000100:00100000:0.0:1788652182.081131:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147696000 00000100:00100000:0.0:1788652182.081164:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788652182.081171:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+9:22729:x1875537147696000:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652182.082170:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+9:22729:x1875537147696000:12345-0@lo:503:mount.lustre.0 Request processed in 996us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652182.082179:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788652182.082280:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147696000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652182.088323:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22768:1875537147696128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652182.088444:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652182.088790:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12300 going to sleep for 11 seconds 00000100:00100000:2.0:1788652182.094348:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147696128 00000100:00100000:2.0:1788652182.094362:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147696128 00000100:00100000:2.0:1788652182.094441:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788652182.094450:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c384d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+9:22768:x1875537147696128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652182.095293:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c384d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+9:22768:x1875537147696128:12345-0@lo:502:llog_process_th.0 Request processed in 842us (6847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652182.095302:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788652182.095636:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22768:1875537147696128:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788652182.095674:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652182.095685:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652182.095687:0:22768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788652182.095692:0:22768:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788652182.095695:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652182.095714:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8f85c3d319c0) 00000020:00000080:0.0:1788652182.095729:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788652182.095734:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788652182.095807:0:22768:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788652182.095814:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c5664 00000020:00000080:0.0:1788652182.096156:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788652182.096161:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652182.096165:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652182.096167:0:22768:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788652182.096169:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652182.096172:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652182.096173:0:22768:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788652182.096176:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652182.096184:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8f85c3d34d40) 00000020:00000080:0.0:1788652182.096194:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788652182.096197:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788652182.096198:0:22768:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788652182.096201:0:22768:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788652182.096207:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788652182.096252:0:22768:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86f3c9f800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788652182.096264:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8f85c3d30000) 00000020:00000080:0.0:1788652182.096271:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788652182.096318:0:22768:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788652182.096322:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c5679 00000020:00000080:0.0:1788652182.096410:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788652182.096416:0:22768:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788652182.096420:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd2f56ea038c5680 00080000:01000000:0.0:1788652182.096425:0:22768:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788652182.096428:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c5687 00010000:00010000:3.0:1788652182.197606:0:22768:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788652182.201116:0:22768:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934638 00000001:00080000:3.0:1788652182.202770:0:22768:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788652182.203582:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8f85c21799c0) 00000020:00000080:3.0:1788652182.203601:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788652182.203669:0:22768:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788652182.203676:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c5695 00000020:00000080:0.0:1788652182.204476:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788652182.217830:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd2f56ea038c569c 00000020:00000080:1.0:1788652182.218198:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788652182.218210:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652182.218218:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652182.218220:0:22768:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788652182.218223:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788652182.218225:0:22768:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788652182.218227:0:22768:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788652182.218229:0:22768:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788652182.218230:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788652182.218236:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652182.218238:0:22768:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788652182.218241:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652182.218247:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652182.218248:0:22768:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788652182.218252:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788652182.218291:0:22768:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788652182.218309:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652182.218312:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652182.218313:0:22768:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788652182.218316:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652182.218319:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652182.218321:0:22768:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788652182.218323:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788652182.218328:0:22768:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:00000080:1.0:1788652182.218355:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788652182.218369:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8f85c20f99c0) 00000020:00000080:1.0:1788652182.218382:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788652182.218387:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788652182.218437:0:22768:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788652182.218442:0:22768:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788652182.218448:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c56aa 00010000:00080000:1.0:1788652182.218479:0:22768:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c3fbc000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.145@tcp at head 00010000:00010000:1.0:1788652182.220452:0:22768:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788652182.221773:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788652182.221786:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788652182.221819:0:22768:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788652182.221838:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c56b1 00000100:00080000:1.0:1788652182.221850:0:22768:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788652182.221857:0:22768:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f85c3fbc000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652182.221898:0:22768:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c348c700 x1875537147696256/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788652182.222135:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147696256:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788652182.222215:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.222370:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147696256 00000100:00100000:2.0:1788652182.222377:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147696256 00000100:00100000:2.0:1788652182.222416:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652182.222424:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147696256:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788652182.222447:0:22755:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788652182.224226:0:22768:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788652182.224367:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652182.224373:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652182.224375:0:22768:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788652182.224378:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788652182.224381:0:22768:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788652182.224383:0:22768:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788652182.224384:0:22768:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788652182.224386:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788652182.224388:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652182.224390:0:22768:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788652182.224392:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788652182.224397:0:22768:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788652182.224401:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652182.224402:0:22768:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788652182.224405:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788652182.224409:0:22768:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:01000000:1.0:1788652182.224440:0:22768:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788652182.224443:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788652182.224459:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f85c20fcd40) 00000020:00000080:1.0:1788652182.224477:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788652182.224483:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788652182.224552:0:22768:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788652182.224558:0:22768:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788652182.224577:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c56bf 00010000:00080000:1.0:1788652182.224608:0:22768:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c373d800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.145@tcp at head 00010000:00010000:1.0:1788652182.224842:0:22768:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788652182.229519:0:22768:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788652182.229757:0:22768:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788652182.232151:0:22768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652182.232475:0:22768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788652182.232642:0:22768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1788652182.235099:0:22774:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788652182.235120:0:22774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1788652182.235865:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147696256:12345-0@lo:38:llog_process_th.0 Request processed in 13435us (13645us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788652182.236137:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652182.236143:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788652182.236147:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147696256:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788652182.236202:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:2.0:1788652182.236821:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788652182.236834:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788652182.236869:0:22768:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788652182.237122:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c56c6 00000100:00080000:2.0:1788652182.237132:0:22768:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652182.237137:0:22768:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f85c373d800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652182.237172:0:22768:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f67afb80 x1875537147696384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788652182.237225:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147696384:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788652182.237268:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147696384 offset 0 length 520: 4 00000100:00080000:2.0:1788652182.237319:0:22768:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788652182.237379:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652182.237384:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652182.237386:0:22768:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788652182.237389:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788652182.237391:0:22768:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788652182.237393:0:22768:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788652182.237394:0:22768:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788652182.237395:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788652182.237398:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652182.237399:0:22768:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788652182.237402:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788652182.237406:0:22768:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788652182.237409:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652182.237411:0:22768:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788652182.237414:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788652182.237418:0:22768:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:01000000:2.0:1788652182.237438:0:22768:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788652182.237449:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788652182.237461:0:22768:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f86f5608000) 00000020:00000080:2.0:1788652182.237473:0:22768:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788652182.237478:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788652182.237536:0:22768:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788652182.237542:0:22768:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788652182.237548:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c56d4 00010000:00080000:2.0:1788652182.237588:0:22768:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c3fbf000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788652182.237785:0:22768:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788652182.237852:0:22768:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788652182.237865:0:22768:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788652182.239939:0:22768:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652182.240258:0:22768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788652182.240399:0:22768:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:0.0:1788652182.240824:0:22776:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788652182.240829:0:22776:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788652182.241522:0:22768:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788652182.241535:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788652182.241592:0:22768:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788652182.241613:0:22768:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c56db 00000100:00080000:3.0:1788652182.241623:0:22768:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788652182.241629:0:22768:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f85c3fbf000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652182.241666:0:22768:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff5dad80 x1875537147696512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652182.241683:0:22768:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788652182.241749:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652182.241754:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652182.241755:0:22768:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788652182.241758:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652182.241762:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652182.241764:0:22768:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788652182.241767:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788652182.241769:0:22768:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788652182.241770:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652182.241773:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652182.241774:0:22768:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788652182.241776:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652182.241778:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652182.241780:0:22768:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788652182.241783:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788652182.241817:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22768:1875537147696640:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788652182.241900:0:22768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652182.241956:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d28f56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.242026:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147696640 00000100:00100000:0.0:1788652182.242033:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147696640 00000100:00100000:1.0:1788652182.242216:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147696512:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788652182.242245:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147696512 offset 0 length 520: 4 00000100:00100000:0.0:1788652182.242372:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788652182.242382:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c384fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+9:22768:x1875537147696640:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652182.242510:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c384fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+9:22768:x1875537147696640:12345-0@lo:502:llog_process_th.0 Request processed in 129us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652182.242519:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788652182.242619:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22768:1875537147696640:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788652182.242642:0:22768:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652182.242647:0:22768:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652182.242648:0:22768:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788652182.242653:0:22768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788652182.242787:0:22729:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788652182.242806:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788652182.242829:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c564f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5656 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.242839:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c564f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5656 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652182.242847:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86f3c9f800 from 1 10000000:01000000:2.0:1788652182.242850:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788652182.243086:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.243096:0:22729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.243108:0:22729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652182.243134:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147696768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652182.243169:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.243253:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c52a2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788652182.243354:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147696768 00000100:00100000:3.0:1788652182.243360:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147696768 00000100:00100000:3.0:1788652182.243397:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788652182.243405:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c384f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+9:22729:x1875537147696768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652182.243415:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652182.243429:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c56e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c56e2 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.243451:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c56e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c56e2 expref: 10 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.243461:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c56e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c56e2 expref: 10 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.243469:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502000, rc 0) 00000100:00100000:3.0:1788652182.243508:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c384f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+10:22729:x1875537147696768:12345-0@lo:101:mount.lustre.0 Request processed in 104us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652182.243514:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788652182.243631:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147696768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652182.243644:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c56e9 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.243654:0:22729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c56e9 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652182.244278:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147696896:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788652182.244321:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.244342:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c52a2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788652182.244494:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147696896 00000100:00100000:3.0:1788652182.244501:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147696896 00000100:00100000:3.0:1788652182.244530:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652182.244601:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f87020ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+10:22729:x1875537147696896:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788652182.244617:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788652182.244624:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788652182.244700:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f87020ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+10:22729:x1875537147696896:12345-0@lo:256:mount.lustre.0 Request processed in 102us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652182.244708:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652182.244833:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147696896:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788652182.245407:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788652182.245432:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c56e9 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.245441:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c56e9 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652182.245449:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86f3c9f800 from 1 10000000:01000000:2.0:1788652182.245451:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652182.245478:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.245495:0:22729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.245504:0:22729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652182.245520:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147697024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652182.245554:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.245589:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c52a2780 going to sleep for 11 seconds 00000100:00100000:3.0:1788652182.245775:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147697024 00000100:00100000:3.0:1788652182.245781:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147697024 00000100:00100000:3.0:1788652182.245810:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652182.245816:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+10:22729:x1875537147697024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652182.245826:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652182.245837:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c1502400/0xcd2f56ea038c56f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c56f0 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.245856:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1502400/0xcd2f56ea038c56f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c56f0 expref: 11 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.245865:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c1502400/0xcd2f56ea038c56f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c56f0 expref: 11 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652182.246065:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502400, rc 0) 00000100:00100000:3.0:1788652182.246112:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+11:22729:x1875537147697024:12345-0@lo:101:mount.lustre.0 Request processed in 295us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652182.246118:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788652182.246213:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147697024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652182.246226:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c56f7 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.246235:0:22729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c56f7 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652182.246299:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147697152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652182.246327:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.246355:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c52a2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.246410:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147697152 00000100:00100000:0.0:1788652182.246414:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147697152 00000100:00100000:0.0:1788652182.246445:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788652182.246452:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+11:22729:x1875537147697152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652182.246597:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+11:22729:x1875537147697152:12345-0@lo:501:mount.lustre.0 Request processed in 145us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652182.246603:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788652182.246676:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147697152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652182.246705:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147697280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652182.246747:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.246769:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c52a2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.246818:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147697280 00000100:00100000:0.0:1788652182.246822:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147697280 00000100:00100000:0.0:1788652182.246841:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788652182.246847:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+11:22729:x1875537147697280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652182.246972:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+11:22729:x1875537147697280:12345-0@lo:503:mount.lustre.0 Request processed in 124us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652182.246978:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788652182.247117:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147697280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652182.247531:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22778:1875537147697408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652182.247583:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.247611:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c52a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.247657:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147697408 00000100:00100000:0.0:1788652182.247662:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147697408 00000100:00100000:0.0:1788652182.247681:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788652182.247687:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+11:22778:x1875537147697408:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652182.248176:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+11:22778:x1875537147697408:12345-0@lo:502:llog_process_th.0 Request processed in 488us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652182.248184:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788652182.248269:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22778:1875537147697408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788652182.248293:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652182.248303:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652182.248305:0:22778:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788652182.248314:0:22778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86f3c9f800 00000020:00000080:2.0:1788652182.248316:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652182.248325:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652182.248328:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652182.248329:0:22778:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788652182.248332:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652182.248334:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652182.248336:0:22778:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788652182.248339:0:22778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86f3c9f800 00000020:00000080:2.0:1788652182.248341:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652182.248407:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652182.248411:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652182.248413:0:22778:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788652182.248416:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652182.248419:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652182.248420:0:22778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788652182.248424:0:22778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86f3c9f800 00000020:00000080:2.0:1788652182.248427:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652182.248446:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652182.248448:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652182.248450:0:22778:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788652182.248453:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652182.248456:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652182.248457:0:22778:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788652182.248461:0:22778:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86f3c9f800 00000020:00000080:2.0:1788652182.248463:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788652182.248508:0:22778:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22778:1875537147697536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652182.248544:0:22778:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.248585:0:22778:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c52a20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.250174:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147697536 00000100:00100000:0.0:1788652182.250186:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147697536 00000100:00100000:0.0:1788652182.250240:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788652182.250249:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+11:22778:x1875537147697536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652182.250383:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+11:22778:x1875537147697536:12345-0@lo:502:llog_process_th.0 Request processed in 135us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652182.250391:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788652182.250496:0:22778:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22778:1875537147697536:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788652182.250527:0:22778:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652182.250534:0:22778:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652182.250537:0:22778:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788652182.250542:0:22778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788652182.250711:0:22729:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788652182.250732:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788652182.250755:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c56f7 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652182.250766:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c56f7 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652182.250811:0:22729:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788652182.250814:0:22729:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f86f3c9f800 10000000:01000000:0.0:1788652182.250822:0:22729:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f86f3c9f800 10000000:01000000:0.0:1788652182.250826:0:22729:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788652182.250831:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86f3c9f800 from 1 10000000:01000000:0.0:1788652182.250834:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788652182.250864:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c56fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652182.250873:0:22729:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c56fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652182.250975:0:22729:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c56fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652182.250994:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147697664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788652182.251028:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652182.251056:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2d323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.251071:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147697664 00000100:00100000:0.0:1788652182.251075:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147697664 00000100:00100000:0.0:1788652182.251099:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652182.251105:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+11:22729:x1875537147697664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652182.251113:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652182.251124:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c5705 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c56fe expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652182.251143:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c5705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c56fe expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652182.251153:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c5705 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c56fe expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652182.251172:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4a00, rc 0) 00000100:00100000:0.0:1788652182.251202:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22729:x1875537147697664:12345-0@lo:101:mount.lustre.0 Request processed in 96us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652182.251208:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652182.251240:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147697664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652182.251252:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c56fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5705 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652182.251261:0:22729:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c56fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5705 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652182.251307:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147697792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652182.251330:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652182.251344:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2d323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.251356:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147697792 00000100:00100000:0.0:1788652182.251359:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147697792 00000100:00100000:0.0:1788652182.251378:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788652182.251383:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22729:x1875537147697792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652182.251479:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22729:x1875537147697792:12345-0@lo:501:mount.lustre.0 Request processed in 95us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652182.251485:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788652182.251513:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147697792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652182.251534:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147697920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652182.251577:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652182.251599:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2d323c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.251610:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147697920 00000100:00100000:0.0:1788652182.251613:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147697920 00000100:00100000:0.0:1788652182.251632:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788652182.251636:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22729:x1875537147697920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652182.251704:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22729:x1875537147697920:12345-0@lo:503:mount.lustre.0 Request processed in 67us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652182.251709:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788652182.251744:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147697920:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652182.253113:0:22779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22779:1875537147698048:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652182.253170:0:22779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.253200:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147698048 00000100:00100000:2.0:1788652182.253205:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147698048 00000100:00100000:2.0:1788652182.253238:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788652182.253245:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22779:x1875537147698048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652182.253335:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22779:x1875537147698048:12345-0@lo:502:llog_process_th.0 Request processed in 90us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652182.253343:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788652182.253389:0:22779:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c52a29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652182.253405:0:22779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22779:1875537147698048:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788652182.253459:0:22779:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788652182.253474:0:22779:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8f86f560b380) 00000020:00000080:2.0:1788652182.253493:0:22779:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788652182.253585:0:22779:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86f3c9f800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788652182.253590:0:22779:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86f3c9f800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788652182.253592:0:22779:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86f3c9f800 4 00010000:00080000:2.0:1788652182.253626:0:22779:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f86edd6d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788652182.257107:0:22779:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788652182.257299:0:22779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788652182.257340:0:22779:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788652182.257354:0:22779:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd2f56ea038c5713 00000100:00080000:2.0:1788652182.257366:0:22779:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652182.257372:0:22779:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f86edd6d000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652182.257407:0:22779:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f67aca80 x1875537147698176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652182.257445:0:22779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788652182.258361:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147698176:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788652182.258432:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652182.258512:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147698176 00000100:00100000:1.0:1788652182.258520:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147698176 00000100:00100000:1.0:1788652182.258553:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652182.258560:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147698176:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788652182.258622:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147698176:12345-0@lo:38:llog_process_th.0 Request processed in 61us (189us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788652182.258630:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652182.258666:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788652182.258673:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86edd6d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652182.258677:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788652182.258681:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147698176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788652182.260479:0:22779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22779:1875537147698304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652182.260550:0:22779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.260601:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147698304 00000100:00100000:2.0:1788652182.260607:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147698304 00000100:00100000:2.0:1788652182.260650:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788652182.260658:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22779:x1875537147698304:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652182.260768:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22779:x1875537147698304:12345-0@lo:502:llog_process_th.0 Request processed in 110us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652182.260775:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788652182.260816:0:22779:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c52a2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652182.260833:0:22779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22779:1875537147698304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652182.260871:0:22779:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22779:1875537147698432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652182.261137:0:22779:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.261157:0:22779:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c547bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.262004:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147698432 00000100:00100000:0.0:1788652182.262011:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147698432 00000100:00100000:0.0:1788652182.262052:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788652182.262060:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22779:x1875537147698432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652182.269486:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22779:x1875537147698432:12345-0@lo:502:llog_process_th.0 Request processed in 7419us (8340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652182.269500:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788652182.269651:0:22779:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f967659c-eb6d-423b-8189-3d2637ee2451:22779:1875537147698432:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788652182.269693:0:22779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788652182.273032:0:22729:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788652182.273070:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788652182.273131:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c56fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5705 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652182.273144:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c56fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5705 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788652182.273193:0:22729:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788652182.273195:0:22729:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788652182.273197:0:22729:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652182.273198:0:22729:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652182.273203:0:22729:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652182.273205:0:22729:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652182.273206:0:22729:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788652182.273207:0:22729:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788652182.273209:0:22729:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652182.273211:0:22729:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788652182.273215:0:22729:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788652182.273217:0:22729:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788652182.273218:0:22729:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788652182.273219:0:22729:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652182.273220:0:22729:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652182.273221:0:22729:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652182.273222:0:22729:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652182.273223:0:22729:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788652182.273224:0:22729:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788652182.273225:0:22729:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652182.273226:0:22729:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788652182.273250:0:22729:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788652182.273267:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147698560:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788652182.273329:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652182.273370:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788652182.273472:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147698560 00000100:00100000:2.0:1788652182.273485:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147698560 00000100:00100000:2.0:1788652182.273574:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788652182.273584:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+12:22729:x1875537147698560:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788652182.273611:0:22744:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788652182.273623:0:22744:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788652182.278401:0:22744:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788652182.278414:0:22744:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788652182.278459:0:22766:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788652182.278464:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788652182.278486:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.278504:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c56e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c56e2 expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.278511:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.278549:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c56e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c56e2 expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.278574:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c56e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c56e2 expref: 12 pid: 22745 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652182.278589:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147698688:0@lo:104: 00000100:00100000:2.0:1788652182.278657:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652182.278703:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c547bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652182.278897:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147698688 00000100:00100000:0.0:1788652182.278931:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147698688 00000100:00100000:0.0:1788652182.278977:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652182.278987:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+3:22766:x1875537147698688:12345-0@lo:104: 00010000:00010000:0.0:1788652182.278999:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c56e9 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652182.279054:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788652182.279060:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+3:22766:x1875537147698688:12345-0@lo:104: Request processed in 76us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652182.279067:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652182.279104:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147698688:0@lo:104: 00010000:00010000:0.0:1788652182.279125:0:22766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.279326:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652182.279333:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c56e9 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.279350:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0031e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788652182.279354:0:22739:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c56e9 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.279362:0:22739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c56e9 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652182.279369:0:22739:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c56e9 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652182.279375:0:22739:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652182.279403:0:22739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c56e9 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.279409:0:22739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652182.279434:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c56e9 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.279441:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c56e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c56e9 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652182.279458:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652182.279460:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652182.279461:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652182.282178:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f967659c-eb6d-423b-8189-3d2637ee2451:3638:1875537147698816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652182.282242:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652182.282394:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147698816 00000100:00100000:1.0:1788652182.282403:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147698816 00010000:00010000:1.0:1788652182.282435:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c56e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c56e2 expref: 13 pid: 22745 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652182.282472:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652182.282482:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+13:3638:x1875537147698816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652182.282495:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652182.282500:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c56e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c56e2 expref: 13 pid: 22745 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282527:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c56e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c56e2 expref: 13 pid: 22745 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282544:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c56e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c56e2 expref: 13 pid: 22745 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282559:0:22735:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282579:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788652182.282594:0:22735:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004130654s 00010000:00010000:1.0:1788652182.282598:0:22735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282605:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282611:0:22735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282617:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282623:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0031c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652182.282628:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282636:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282661:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282671:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652182.282709:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+12:3638:x1875537147698816:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652182.282719:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788652182.282742:0:22766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282750:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652182.282757:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c571a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652182.282790:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f967659c-eb6d-423b-8189-3d2637ee2451:3638:1875537147698816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652182.287664:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+11:22729:x1875537147698560:12345-0@lo:253:mount.lustre.0 Request processed in 14072us (14325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652182.287679:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788652182.287793:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa35880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:22729:1875537147698560:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788652182.287809:0:22729:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788652182.287813:0:22729:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788652182.287814:0:22729:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788652182.287815:0:22729:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652182.287816:0:22729:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652182.287818:0:22729:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652182.287819:0:22729:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652182.287820:0:22729:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788652182.287822:0:22729:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788652182.287824:0:22729:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652182.287825:0:22729:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788652182.287839:0:22729:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:1.0:1788652182.324151:0:22729:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:1.0:1788652182.324390:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788652182.324530:0:22790:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1788652182.324538:0:22790:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:3.0:1788652182.324637:0:22791:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1788652182.324887:0:22791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788652182.325037:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788652182.327240:0:22791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788652182.327331:0:22791:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:3.0:1788652182.327409:0:22792:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8f86ff5d9500 x1875537147698944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652182.327422:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00000040:01000000:1.0:1788652182.327817:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788652182.327856:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788652182.328291:0:22729:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788652182.328298:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788652182.328330:0:22729:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652182.329343:0:22729:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788652182.329895:0:22729:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788652182.329947:0:22729:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788652182.336663:0:22729:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:2.0:1788652182.337298:0:22729:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1788652182.340364:0:22729:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1788652182.342085:0:22729:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788652182.342117:0:22729:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa71c0166f988 00100000:10000000:2.0:1788652182.342124:0:22729:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788652182.342782:0:22729:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788652182.342795:0:22729:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.145@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788652182.342812:0:22729:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788652182.342827:0:22729:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788652182.352551:0:22729:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788652182.352786:0:22729:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788652182.953069:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788652183.136978:0:22748:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788652183.136986:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86f3c9f800 from 11 10000000:01000000:2.0:1788652183.136992:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788652183.137046:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652183.137059:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652183.137070:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652183.137097:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147699072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652183.137164:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652183.137206:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652183.137363:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147699072 00000100:00100000:0.0:1788652183.137372:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147699072 00000100:00100000:0.0:1788652183.137435:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788652183.137445:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+11:22748:x1875537147699072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652183.137459:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652183.137474:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5000/0xcd2f56ea038c5728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5721 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652183.137497:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5000/0xcd2f56ea038c5728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5721 expref: 12 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652183.137508:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5000/0xcd2f56ea038c5728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5721 expref: 12 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652183.137518:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5000, rc 0) 00000100:00100000:0.0:1788652183.137583:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+12:22748:x1875537147699072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652183.137590:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788652183.137737:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147699072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652183.137753:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5728 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652183.137771:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5728 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652183.137836:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147699200:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788652183.137877:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652183.137896:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788652183.138215:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147699200 00000100:00100000:2.0:1788652183.138221:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147699200 00000100:00100000:2.0:1788652183.138250:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788652183.138257:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22748:x1875537147699200:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788652183.138270:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788652183.138287:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788652183.138290:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788652183.140426:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:22748:x1875537147699200:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 2149us (2538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652183.140439:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788652183.142431:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147699200:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788652183.143328:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788652183.143340:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5728 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652183.143351:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5728 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652183.346099:0:22786:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788652183.346110:0:22786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788652183.346651:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00000040:00080000:1.0:1788652183.357606:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788652183.357622:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788652183.971113:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652184.352136:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00000040:00080000:1.0:1788652184.416126:0:22786:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788652184.416142:0:22786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788652184.416326:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:1.0:1788652184.416380:0:22786:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788652184.416562:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:1.0:1788652184.992077:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652185.379062:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00000001:02000400:1.0:1788652185.835501:0:23035:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788652186.016460:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652186.400123:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00000020:00000004:3.0:1788652186.727814:0:23088:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788652186.728092:0:23088:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788652187.041044:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652187.423986:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00000020:00000004:2.0:1788652187.481968:0:23138:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788652187.484564:0:23138:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00080000:1.0:1788652187.617226:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788652187.617233:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788652187.617237:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652187.617245:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:1.0:1788652187.617260:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788652187.617267:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f85c3fbc000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652187.617291:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c348e680 x1875537147699456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788652187.617321:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652187.617324:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652187.617326:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652187.617330:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652187.617332:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788652187.617334:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788652187.617336:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f86edd6d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652187.617340:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f86edd6d000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652187.617351:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c348f480 x1875537147699584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652187.617393:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147699328:0@lo:400:kworker.0 00000100:00100000:1.0:1788652187.617458:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652187.617546:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147699328 00000100:00100000:1.0:1788652187.617555:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147699328 00000100:00100000:1.0:1788652187.617595:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788652187.617603:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+12:3635:x1875537147699328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652187.617648:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+12:3635:x1875537147699328:12345-0@lo:400:kworker.0 Request processed in 46us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652187.617654:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788652187.617939:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147699328:0@lo:400:kworker.0 00000100:00100000:0.0:1788652187.618019:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147699456:0@lo:38:kworker.0 00000100:00100000:0.0:1788652187.618051:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652187.618154:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147699584:0@lo:38:kworker.0 00000100:00100000:0.0:1788652187.618183:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652187.618548:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147699584 00000100:00100000:0.0:1788652187.618554:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147699584 00000100:00100000:0.0:1788652187.618580:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652187.618586:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875537147699584:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788652187.618607:0:22752:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 643 last 0 00000020:00000080:0.0:1788652187.618640:0:22752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd2f56ea038c572f 00000004:00100000:0.0:1788652187.618654:0:22752:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788652187.618773:0:22752:0:(import.c:65:import_set_state_nolock()) ffff8f85c354f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652187.618815:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875537147699584:12345-0@lo:38:kworker.0 Request processed in 228us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652187.618822:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788652187.618855:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f85c348f480 x1875537147699584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788652187.618867:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788652187.618874:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788652187.618879:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788652187.618887:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86edd6d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788652187.618892:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147699584:0@lo:38:kworker.0 00000100:00100000:1.0:1788652187.621557:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147699456 00000100:00100000:1.0:1788652187.621569:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147699456 00000100:00100000:1.0:1788652187.621601:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652187.621608:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875537147699456:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788652187.621627:0:22756:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788652187.621705:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875537147699456:12345-0@lo:38:kworker.0 Request processed in 95us (3652us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788652187.621711:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788652187.621784:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788652187.621790:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788652187.621794:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147699456:0@lo:38:kworker.0 00010000:00010000:1.0:1788652188.064161:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652188.448219:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00010000:00010000:1.0:1788652189.088942:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652189.472009:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00010000:00010000:1.0:1788652190.116564:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652190.496300:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00010000:00010000:3.0:1788652191.139005:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652191.521859:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00010000:00010000:1.0:1788652192.160516:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652192.544043:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00000100:00080000:2.0:1788652192.739127:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788652192.739134:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788652192.739138:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788652192.739147:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 643 00000100:00080000:2.0:1788652192.739152:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788652192.739158:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f85c3fbc000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652192.739182:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f67ace00 x1875537147699840/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652192.739197:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652192.739201:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788652192.739203:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652192.739206:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788652192.739279:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147699712:0@lo:400:kworker.0 00000100:00100000:1.0:1788652192.739348:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652192.739425:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652192.739434:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147699968:0@lo:400:kworker.0 00000100:00100000:1.0:1788652192.739462:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652192.739505:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147699968 00000100:00100000:1.0:1788652192.739514:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147699968 00000100:00100000:1.0:1788652192.739776:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652192.739787:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147699968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652192.739839:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147699968:12345-0@lo:400:kworker.0 Request processed in 54us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652192.739847:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788652192.739887:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f86f67aed80 x1875537147699968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652208 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652192.739974:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652182/real 1788652182] req@ffff8f86ff5dad80 x1875537147696512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652192 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652192.739991:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86ff5dad80 x1875537147696512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652192 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652192.740060:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652182/real 1788652182] req@ffff8f86f67afb80 x1875537147696384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652192 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652192.740074:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86f67afb80 x1875537147696384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652192 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652192.740087:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147699840:0@lo:38:kworker.0 00000100:00100000:0.0:1788652192.740130:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788652192.740163:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652192.740175:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788652192.740179:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147696512:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788652192.740184:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c373d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652192.740188:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788652192.740192:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147696384:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1788652192.740246:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147699840 00000100:00100000:0.0:1788652192.740251:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147699840 00000100:00100000:0.0:1788652192.740279:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788652192.740285:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147699840:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788652192.740300:0:22755:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788652192.740333:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147699840:12345-0@lo:38:kworker.0 Request processed in 48us (202us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788652192.740340:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788652192.740461:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147699968:0@lo:400:kworker.0 00000100:00100000:2.0:1788652192.740723:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147699712 00000100:00100000:2.0:1788652192.740728:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147699712 00000100:00100000:2.0:1788652192.740767:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788652192.740774:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+12:3636:x1875537147699712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652192.740814:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+12:3636:x1875537147699712:12345-0@lo:400:kworker.0 Request processed in 41us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652192.740820:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788652192.740848:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652192.740858:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788652192.740860:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f85c373d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788652192.740865:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:2.0:1788652192.740868:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788652192.740873:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f85c373d800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652192.740896:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f67ae300 x1875537147700096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652192.740923:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652192.740926:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788652192.740928:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788652192.740931:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 638 00000100:00080000:2.0:1788652192.740934:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788652192.740937:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f85c3fbf000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652192.740948:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f67aea00 x1875537147700224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788652192.741074:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652192.741079:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788652192.741082:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147699840:0@lo:38:kworker.0 00000100:00100000:0.0:1788652192.741100:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147700096:0@lo:8:kworker.0 00000100:00100000:1.0:1788652192.741243:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147699712:0@lo:400:kworker.0 00000400:00000100:0.0:1788652192.741296:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147700096 offset 0 length 520: 4 00000100:00100000:0.0:1788652192.741322:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147700224:0@lo:8:kworker.0 00000400:00000100:0.0:1788652192.741357:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147700224 offset 0 length 520: 4 00010000:00010000:3.0:1788652193.184021:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652193.569021:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00010000:00010000:1.0:1788652194.208996:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652194.596765:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00000040:00080000:3.0:1788652194.657871:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:3.0:1788652195.059615:0:23483:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788652195.059618:0:23483:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788652195.059625:0:23483:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788652195.059794:0:23483:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f86c92db800 00000020:01000004:3.0:1788652195.059808:0:23483:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788652195.059818:0:23483:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788652195.059829:0:23483:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8f85c217cd40) 00000020:00000080:3.0:1788652195.059843:0:23483:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788652195.135332:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788652195.135577:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.137040:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.137240:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.137437:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.137714:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.138049:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.138301:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.138590:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.138814:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.139097:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.139341:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.139684:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.140025:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.140217:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.140441:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.140737:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.141015:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.141242:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.141546:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.141776:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.142058:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.142301:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.142576:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.142806:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.143173:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.143381:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.143631:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.143824:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.144142:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788652195.144347:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.144592:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.144969:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.145169:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788652195.145641:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788652195.146200:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788652195.146394:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788652195.147044:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788652195.147268:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788652195.147543:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788652195.147956:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788652195.148145:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788652195.148418:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788652195.148741:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788652195.149006:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788652195.149194:0:23483:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:2.0:1788652195.152587:0:23483:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788652195.153081:0:23483:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788652195.153094:0:23483:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788652195.153108:0:23483:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c573d 00000020:01000004:2.0:1788652195.153115:0:23483:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788652195.153138:0:23483:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788652195.153142:0:23483:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788652195.153148:0:23483:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788652195.153178:0:23483:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788652195.153182:0:23483:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.145@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788652195.158280:0:23483:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788652195.158335:0:23483:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.145@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788652195.158344:0:23483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788652195.158346:0:23483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788652195.158347:0:23483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652195.158348:0:23483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652195.158349:0:23483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652195.158350:0:23483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652195.158351:0:23483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788652195.158353:0:23483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652195.158354:0:23483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788652195.158358:0:23483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788652195.158360:0:23483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788652195.158361:0:23483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788652195.158362:0:23483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652195.158362:0:23483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652195.158363:0:23483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652195.158364:0:23483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652195.158365:0:23483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788652195.158366:0:23483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652195.158366:0:23483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788652195.158394:0:23483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788652195.158415:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147700352:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788652195.158565:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652195.158674:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c96a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652195.158717:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147700352 00000100:00100000:1.0:1788652195.158727:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147700352 00000100:00100000:1.0:1788652195.158818:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788652195.158836:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:23483:x1875537147700352:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788652195.158865:0:22745:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788652195.158868:0:22745:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788652195.158875:0:22745:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788652195.159301:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:23483:x1875537147700352:12345-0@lo:253:mount.lustre.0 Request processed in 473us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652195.159310:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788652195.159412:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5db100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147700352:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788652195.159422:0:23483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788652195.159425:0:23483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788652195.159426:0:23483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788652195.159428:0:23483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652195.159429:0:23483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652195.159431:0:23483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652195.159432:0:23483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652195.159433:0:23483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788652195.159435:0:23483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652195.159435:0:23483:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788652195.159464:0:23483:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f86c92db800 from lustre-MDT0001 10000000:01000000:0.0:1788652195.159491:0:23483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788652195.159493:0:23483:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788652195.159509:0:23483:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f85c20fb380 local copy 00010000:00010000:0.0:1788652195.159519:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652195.159600:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147700480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652195.159642:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.159902:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12240 going to sleep for 11 seconds 00000100:00100000:2.0:1788652195.160062:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147700480 00000100:00100000:2.0:1788652195.160069:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147700480 00000100:00100000:2.0:1788652195.160104:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788652195.160111:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+12:23483:x1875537147700480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652195.160209:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+12:23483:x1875537147700480:12345-0@lo:501:mount.lustre.0 Request processed in 97us (566us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788652195.160216:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788652195.160288:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147700480:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788652195.160304:0:23483:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788652195.160333:0:23483:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788652195.160340:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.160349:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652195.160375:0:23483:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f86c92db800 10000000:01000000:0.0:1788652195.160380:0:23483:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788652195.160384:0:23483:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f85c20fb380 10000000:01000000:0.0:1788652195.160387:0:23483:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788652195.160390:0:23483:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f85c20fb380 from 1 10000000:01000000:0.0:1788652195.160393:0:23483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788652195.160419:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5c00/0xcd2f56ea038c5744 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.160427:0:23483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5c00/0xcd2f56ea038c5744 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.160435:0:23483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5c00/0xcd2f56ea038c5744 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652195.160519:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147700608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788652195.160546:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.160570:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12240 going to sleep for 11 seconds 00000100:00100000:1.0:1788652195.160655:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147700608 00000100:00100000:1.0:1788652195.160660:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147700608 00000100:00100000:1.0:1788652195.160686:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788652195.160692:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+12:23483:x1875537147700608:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652195.160701:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652195.160713:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff414a00/0xcd2f56ea038c574b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5744 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.160735:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414a00/0xcd2f56ea038c574b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5744 expref: 13 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.160746:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff414a00/0xcd2f56ea038c574b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5744 expref: 13 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.160762:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414a00, rc 0) 00000100:00100000:1.0:1788652195.160792:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+13:23483:x1875537147700608:12345-0@lo:101:mount.lustre.0 Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652195.160798:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788652195.161056:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147700608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652195.161069:0:23483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5c00/0xcd2f56ea038c5744 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c574b expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.161078:0:23483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5c00/0xcd2f56ea038c5744 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c574b expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652195.161094:0:23483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788652195.161112:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5c00/0xcd2f56ea038c5744 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c574b expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.161119:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5c00/0xcd2f56ea038c5744 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c574b expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652195.161128:0:23483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f86c92db800 10000000:01000000:0.0:1788652195.161132:0:23483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788652195.161135:0:23483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f86c92db800 from 1 10000000:01000000:0.0:1788652195.161138:0:23483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788652195.161153:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c5752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.161160:0:23483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c5752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.161167:0:23483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c5752 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652195.161185:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147700736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788652195.161210:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.161236:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12240 going to sleep for 11 seconds 00000100:00100000:1.0:1788652195.161291:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147700736 00000100:00100000:1.0:1788652195.161296:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147700736 00000100:00100000:1.0:1788652195.161339:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788652195.161346:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+13:23483:x1875537147700736:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652195.161353:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652195.161361:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c5759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5752 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.161375:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c5759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5752 expref: 14 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.161384:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c5759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5752 expref: 14 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.161390:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415200, rc 0) 00000100:00100000:1.0:1788652195.161419:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+14:23483:x1875537147700736:12345-0@lo:101:mount.lustre.0 Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652195.161425:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788652195.161597:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147700736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652195.161608:0:23483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c5752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5759 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.161615:0:23483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c5752 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5759 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652195.161637:0:23483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788652195.161651:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c5752 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5759 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.161658:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c5752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5759 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652195.161663:0:23483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788652195.161667:0:23483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788652195.161671:0:23483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f86c92db800 10000000:01000000:0.0:1788652195.161674:0:23483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788652195.161677:0:23483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788652195.161679:0:23483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788652195.161692:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c5760 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.161699:0:23483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c5760 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.161713:0:23483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c5760 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652195.161725:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147700864:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788652195.161750:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.161771:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12240 going to sleep for 11 seconds 00000100:00100000:1.0:1788652195.161988:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147700864 00000100:00100000:1.0:1788652195.161993:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147700864 00000100:00100000:1.0:1788652195.162017:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788652195.162024:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+14:23483:x1875537147700864:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652195.162031:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652195.162046:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff414200/0xcd2f56ea038c5767 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5760 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.162062:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414200/0xcd2f56ea038c5767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5760 expref: 15 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.162071:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff414200/0xcd2f56ea038c5767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5760 expref: 15 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.162078:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414200, rc 0) 00000100:00100000:1.0:1788652195.162118:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+15:23483:x1875537147700864:12345-0@lo:101:mount.lustre.0 Request processed in 94us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652195.162124:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788652195.162192:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147700864:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652195.162204:0:23483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c5760 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5767 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652195.162211:0:23483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c5760 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5767 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788652195.163665:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:2.0:1788652195.164287:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652195.168713:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788652195.168773:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:2.0:1788652195.168789:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:2.0:1788652195.168805:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:2.0:1788652195.168818:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:2.0:1788652195.169130:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:2.0:1788652195.169154:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:2.0:1788652195.169170:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:2.0:1788652195.169184:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:2.0:1788652195.169198:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:2.0:1788652195.169215:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:2.0:1788652195.169230:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:2.0:1788652195.169245:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:2.0:1788652195.169260:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:2.0:1788652195.169274:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:2.0:1788652195.169289:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:2.0:1788652195.169329:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:2.0:1788652195.169346:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:2.0:1788652195.169361:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:2.0:1788652195.169374:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:2.0:1788652195.169386:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:2.0:1788652195.169400:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:2.0:1788652195.169412:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:2.0:1788652195.169426:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:2.0:1788652195.169438:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:2.0:1788652195.169535:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:2.0:1788652195.169554:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:2.0:1788652195.169571:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:2.0:1788652195.169586:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:2.0:1788652195.169600:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:2.0:1788652195.169613:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:2.0:1788652195.169625:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:2.0:1788652195.169713:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:2.0:1788652195.169727:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:2.0:1788652195.169740:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:2.0:1788652195.169754:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:2.0:1788652195.169769:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:2.0:1788652195.169781:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:2.0:1788652195.169793:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:2.0:1788652195.169807:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:2.0:1788652195.169821:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:2.0:1788652195.170012:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:2.0:1788652195.170028:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:2.0:1788652195.170039:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:2.0:1788652195.170063:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:2.0:1788652195.170069:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:2.0:1788652195.170168:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147700992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652195.170231:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652195.170397:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0361b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652195.172809:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147700992 00000100:00100000:1.0:1788652195.172882:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147700992 00000100:00100000:1.0:1788652195.173167:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788652195.173179:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+15:23483:x1875537147700992:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652195.173408:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+15:23483:x1875537147700992:12345-0@lo:501:mount.lustre.0 Request processed in 232us (3176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652195.173417:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788652195.173523:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147700992:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652195.173577:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147701120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652195.173641:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652195.174432:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0361b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788652195.174558:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147701120 00000100:00100000:0.0:1788652195.174565:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147701120 00000100:00100000:0.0:1788652195.174603:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788652195.174615:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+15:23483:x1875537147701120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652195.175667:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+15:23483:x1875537147701120:12345-0@lo:503:mount.lustre.0 Request processed in 1049us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652195.175678:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788652195.175822:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147701120:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788652195.176539:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788652195.176623:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147701248:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652195.176744:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652195.176778:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000600 going to sleep for 11 seconds 00000100:00100000:0.0:1788652195.177358:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147701248 00000100:00100000:0.0:1788652195.177366:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147701248 00000100:00100000:0.0:1788652195.177403:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788652195.177412:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+15:23483:x1875537147701248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652195.178791:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+15:23483:x1875537147701248:12345-0@lo:502:mount.lustre.0 Request processed in 1373us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652195.178803:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788652195.178961:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147701248:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652195.179188:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788652195.179392:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788652195.179412:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788652195.179428:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1788652195.179515:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1788652195.179538:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1788652195.179555:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1788652195.179570:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1788652195.179586:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1788652195.179600:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1788652195.179613:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1788652195.179626:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1788652195.179654:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1788652195.179667:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1788652195.179682:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1788652195.179697:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1788652195.179711:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1788652195.179736:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1788652195.179750:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1788652195.179763:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1788652195.179777:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1788652195.179788:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1788652195.179806:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1788652195.179819:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1788652195.183124:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1788652195.183169:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1788652195.183186:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1788652195.183199:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1788652195.183225:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1788652195.183244:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1788652195.183259:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1788652195.183271:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1788652195.183285:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1788652195.183297:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1788652195.183308:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1788652195.183334:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1788652195.183349:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1788652195.183363:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1788652195.183376:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1788652195.183389:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1788652195.183400:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1788652195.183412:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1788652195.183424:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1788652195.183436:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1788652195.183497:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147701376:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652195.183579:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652195.183636:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000600 going to sleep for 11 seconds 00000100:00100000:1.0:1788652195.183656:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147701376 00000100:00100000:1.0:1788652195.183666:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147701376 00000100:00100000:1.0:1788652195.183717:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788652195.183726:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+15:23483:x1875537147701376:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652195.183860:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+15:23483:x1875537147701376:12345-0@lo:502:mount.lustre.0 Request processed in 134us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652195.183869:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788652195.183959:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147701376:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652195.184011:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788652195.184018:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1788652195.184766:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652195.184778:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652195.184780:0:23487:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788652195.184786:0:23487:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788652195.184788:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652195.184801:0:23487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8f86eeba8000) 00000020:00000080:0.0:1788652195.185031:0:23487:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1788652195.185041:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788652195.185126:0:23487:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788652195.185133:0:23487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c5775 00000020:00000080:0.0:1788652195.185406:0:23487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788652195.185411:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652195.185415:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652195.185416:0:23487:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788652195.185419:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652195.185423:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652195.185424:0:23487:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788652195.185428:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652195.185436:0:23487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8f86eeba99c0) 00000020:00000080:0.0:1788652195.185523:0:23487:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1788652195.185531:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788652195.185533:0:23487:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788652195.185535:0:23487:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788652195.185541:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788652195.185593:0:23487:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86c92db800 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788652195.185605:0:23487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8f86eebacd40) 00000020:00000080:0.0:1788652195.185616:0:23487:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1788652195.185737:0:23487:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788652195.185743:0:23487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c578a 00000020:00000080:0.0:1788652195.186011:0:23487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788652195.186018:0:23487:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788652195.186023:0:23487:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcd2f56ea038c5791 00080000:01000000:0.0:1788652195.186029:0:23487:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788652195.186033:0:23487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c5798 00010000:00010000:0.0:1788652195.233441:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652195.307502:0:23487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788652195.309018:0:23487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788652195.310150:0:23487:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788652195.311143:0:23487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788652195.311157:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652195.311164:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.311166:0:23487:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788652195.311170:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652195.311177:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.311178:0:23487:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788652195.311181:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788652195.311186:0:23487:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:00000080:2.0:1788652195.311331:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788652195.311346:0:23487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8f86f560cd40) 00000020:00000080:2.0:1788652195.311366:0:23487:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788652195.311371:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788652195.311447:0:23487:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788652195.311454:0:23487:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788652195.311461:0:23487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c57a6 00010000:00080000:2.0:1788652195.311495:0:23487:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f86eeabf800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788652195.316473:0:23487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788652195.326146:0:23487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788652195.326165:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788652195.326203:0:23487:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788652195.326503:0:23487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c57ad 00000100:00080000:2.0:1788652195.326515:0:23487:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652195.326522:0:23487:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f86eeabf800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652195.326575:0:23487:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f67ae680 x1875537147701504/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652195.326610:0:23487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788652195.326695:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147701504:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788652195.326772:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788652195.328015:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652195.328023:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.328026:0:23487:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788652195.328029:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788652195.328032:0:23487:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788652195.328034:0:23487:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788652195.328035:0:23487:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788652195.328037:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788652195.328040:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.328041:0:23487:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788652195.328043:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652195.328048:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.328050:0:23487:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788652195.328054:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788652195.328102:0:23487:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788652195.328119:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652195.328122:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.328123:0:23487:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788652195.328125:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788652195.328127:0:23487:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:2.0:1788652195.328128:0:23487:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788652195.328130:0:23487:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788652195.328131:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788652195.328134:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.328135:0:23487:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788652195.328137:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788652195.328141:0:23487:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788652195.328144:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.328145:0:23487:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788652195.328148:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788652195.328152:0:23487:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:01000000:2.0:1788652195.328191:0:23487:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788652195.328194:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788652195.328218:0:23487:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f86fb24cd40) 00000020:00000080:2.0:1788652195.328236:0:23487:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788652195.328243:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788652195.328302:0:23487:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788652195.328309:0:23487:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788652195.328335:0:23487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c57bb 00010000:00080000:2.0:1788652195.328366:0:23487:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f86f67f2000@lustre-OST0000-osc-MDT0001: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788652195.329829:0:23487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788652195.330049:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147701504 00000100:00100000:0.0:1788652195.330061:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147701504 00000100:00100000:0.0:1788652195.330110:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788652195.330120:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147701504:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788652195.330158:0:22755:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 651 last 0 00000020:00000080:0.0:1788652195.330196:0:22755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c57c2 00000004:00100000:0.0:1788652195.330226:0:22755:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788652195.330233:0:22755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:2.0:1788652195.337878:0:23487:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788652195.338368:0:23487:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788652195.338702:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788652195.338708:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788652195.338712:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652195.338722:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:3.0:1788652195.338727:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788652195.338734:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f85c3fbc000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652195.338773:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff5da680 x1875537147701632/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652195.338842:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147701632:0@lo:38:kworker.0 00000100:00100000:1.0:1788652195.338947:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652195.339046:0:22756:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788652195.339055:0:22756:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:3.0:1788652195.339401:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652195.339413:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652195.339416:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652195.339419:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788652195.339468:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147701760:0@lo:400:kworker.0 00000100:00100000:3.0:1788652195.339508:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652195.339557:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147701760 00000100:00100000:3.0:1788652195.339566:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147701760 00000100:00100000:3.0:1788652195.339613:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652195.339623:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147701760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652195.339680:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147701760:12345-0@lo:400:kworker.0 Request processed in 59us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.339689:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652195.340665:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147701632 00000100:00100000:0.0:1788652195.340672:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147701632 00000100:00100000:0.0:1788652195.340764:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788652195.340771:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875537147701632:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788652195.340950:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f86ff5d9c00 x1875537147701760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652195.340964:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147701760:0@lo:400:kworker.0 00000040:00080000:3.0:1788652195.342626:0:23487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652195.342862:0:23487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788652195.343040:0:23487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788652195.344704:0:23493:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788652195.344710:0:23493:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000100:00100000:0.0:1788652195.349283:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875537147701632:12345-0@lo:38:kworker.0 Request processed in 8501us (10325us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788652195.349299:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788652195.349456:0:22755:0:(import.c:65:import_set_state_nolock()) ffff8f86ea1e4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652195.349530:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875537147701504:12345-0@lo:38:llog_process_th.0 Request processed in 19411us (22757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652195.349538:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:00000080:3.0:1788652195.349967:0:23487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788652195.349983:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788652195.350028:0:23487:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788652195.350047:0:23487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c57c9 00000100:00080000:3.0:1788652195.350055:0:23487:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788652195.350060:0:23487:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f86f67f2000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652195.350089:0:23487:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff5d8a80 x1875537147701888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652195.350106:0:23487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788652195.350173:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652195.350178:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652195.350179:0:23487:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788652195.350182:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788652195.350185:0:23487:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:3.0:1788652195.350187:0:23487:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788652195.350189:0:23487:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788652195.350190:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788652195.350192:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652195.350193:0:23487:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788652195.350195:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788652195.350199:0:23487:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788652195.350202:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652195.350204:0:23487:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788652195.350207:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788652195.350211:0:23487:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:01000000:3.0:1788652195.350233:0:23487:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788652195.350236:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788652195.350247:0:23487:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f85c217b380) 00000020:00000080:3.0:1788652195.350261:0:23487:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788652195.350266:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788652195.350336:0:23487:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788652195.350342:0:23487:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788652195.350347:0:23487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c57d7 00010000:00080000:3.0:1788652195.350377:0:23487:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c3dc4800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.145@tcp at head 00010000:00010000:3.0:1788652195.350574:0:23487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788652195.350645:0:23487:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788652195.350660:0:23487:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1788652195.350962:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652195.350968:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652195.350970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652195.350973:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788652195.352408:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788652195.352418:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652195.352424:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788652195.352428:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147701632:0@lo:38:kworker.0 00000100:00100000:1.0:1788652195.352442:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788652195.352450:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788652195.352458:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788652195.352465:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788652195.352467:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86eeabf800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788652195.352746:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147701504:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788652195.352783:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147701888:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788652195.352833:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147701888 offset 0 length 520: 4 00000100:00100000:0.0:1788652195.353033:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147702016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788652195.353073:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652195.353840:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147702016 00000100:00100000:2.0:1788652195.353850:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147702016 00000100:00100000:2.0:1788652195.353923:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652195.353935:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1875537147702016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788652195.353971:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788652195.354034:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3635:x1875537147702016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652195.354041:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788652195.354100:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147702016:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788652195.355272:0:23487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652195.355576:0:23487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788652195.355843:0:23487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:0.0:1788652195.363612:0:23495:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788652195.363790:0:23495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788652195.364456:0:23487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788652195.364475:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788652195.364515:0:23487:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788652195.364538:0:23487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c57de 00000100:00080000:3.0:1788652195.364550:0:23487:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788652195.364557:0:23487:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f85c3dc4800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652195.364597:0:23487:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff5da300 x1875537147702144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652195.364617:0:23487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788652195.364739:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652195.364744:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652195.364746:0:23487:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788652195.364749:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652195.364753:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652195.364754:0:23487:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788652195.364757:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788652195.364759:0:23487:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788652195.364761:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652195.364763:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652195.364764:0:23487:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788652195.364766:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652195.364768:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652195.364769:0:23487:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788652195.364773:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788652195.364794:0:23487:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652195.364797:0:23487:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652195.364798:0:23487:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788652195.364801:0:23487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:0.0:1788652195.365074:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652195.365080:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652195.365082:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652195.365085:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788652195.365104:0:23483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788652195.365135:0:23483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00000100:00100000:1.0:1788652195.365151:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147702144:0@lo:8:llog_process_th.0 00010000:00010000:2.0:1788652195.365157:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c5760 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5767 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652195.365173:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c5760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5767 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652195.365181:0:23483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86c92db800 from 1 10000000:01000000:2.0:1788652195.365184:0:23483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000400:00000100:1.0:1788652195.365216:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147702144 offset 0 length 520: 4 00010000:00010000:2.0:1788652195.365219:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652195.365226:0:23483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652195.365237:0:23483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652195.365253:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147702272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652195.365288:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652195.365321:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652195.365373:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147702272 00000100:00100000:3.0:1788652195.365381:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147702272 00000100:00100000:3.0:1788652195.365431:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788652195.365441:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+15:23483:x1875537147702272:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652195.365463:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652195.365477:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c57ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c57e5 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.365502:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c57ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c57e5 expref: 16 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.365514:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c57ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c57e5 expref: 16 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.365522:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502c00, rc 0) 00000100:00100000:3.0:1788652195.365574:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+16:23483:x1875537147702272:12345-0@lo:101:mount.lustre.0 Request processed in 135us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.365582:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788652195.365727:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147702272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652195.365743:0:23483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c57ec expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.365753:0:23483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c57ec expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652195.366837:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147702400:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788652195.366897:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.367050:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c300 going to sleep for 11 seconds 00000100:00100000:1.0:1788652195.370432:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147702400 00000100:00100000:1.0:1788652195.370451:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147702400 00000100:00100000:2.0:1788652195.370597:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788652195.370609:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+16:23483:x1875537147702400:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788652195.370638:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788652195.370663:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788652195.370667:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788652195.370818:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+16:23483:x1875537147702400:12345-0@lo:256:mount.lustre.0 Request processed in 210us (3919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652195.370827:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788652195.371016:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147702400:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788652195.371583:0:23483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788652195.371602:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c57ec expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.371613:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c57ec expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652195.371621:0:23483:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86c92db800 from 1 10000000:01000000:0.0:1788652195.371949:0:23483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788652195.371986:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.372006:0:23483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.372017:0:23483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652195.372038:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147702528:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788652195.372082:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.372120:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788652195.372182:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147702528 00000100:00100000:3.0:1788652195.372189:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147702528 00000100:00100000:3.0:1788652195.372236:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788652195.372245:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+16:23483:x1875537147702528:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652195.372256:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652195.372268:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c57fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c57f3 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.372291:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c57fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c57f3 expref: 17 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.372303:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c57fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c57f3 expref: 17 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.372324:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502000, rc 0) 00000100:00100000:3.0:1788652195.372371:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+17:23483:x1875537147702528:12345-0@lo:101:mount.lustre.0 Request processed in 127us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.372378:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788652195.372485:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147702528:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652195.372500:0:23483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c57fa expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652195.372509:0:23483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c57fa expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652195.374092:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:0.0:1788652195.374638:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652195.374850:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788652195.374875:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:0.0:1788652195.374889:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:0.0:1788652195.374902:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:0.0:1788652195.375060:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:0.0:1788652195.375076:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:0.0:1788652195.375093:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:0.0:1788652195.375108:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:0.0:1788652195.375121:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788652195.375134:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:0.0:1788652195.375160:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:0.0:1788652195.375179:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:0.0:1788652195.375185:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:0.0:1788652195.375352:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147702656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652195.375418:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.375564:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788652195.378746:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147702656 00000100:00100000:2.0:1788652195.378762:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147702656 00000100:00100000:2.0:1788652195.378883:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788652195.378894:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+17:23483:x1875537147702656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652195.379088:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+17:23483:x1875537147702656:12345-0@lo:501:mount.lustre.0 Request processed in 196us (3669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652195.379097:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788652195.379241:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147702656:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652195.379293:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147702784:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652195.379367:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.380541:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788652195.380687:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147702784 00000100:00100000:3.0:1788652195.380697:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147702784 00000100:00100000:3.0:1788652195.380744:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788652195.380756:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+17:23483:x1875537147702784:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652195.380900:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+17:23483:x1875537147702784:12345-0@lo:503:mount.lustre.0 Request processed in 148us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.380930:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788652195.381062:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147702784:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788652195.381544:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788652195.381802:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147702912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652195.381856:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.381894:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788652195.381987:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147702912 00000100:00100000:2.0:1788652195.381993:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147702912 00000100:00100000:2.0:1788652195.382030:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788652195.382038:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+17:23483:x1875537147702912:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652195.382144:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+17:23483:x1875537147702912:12345-0@lo:502:mount.lustre.0 Request processed in 106us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652195.382152:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788652195.382340:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147702912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788652195.382516:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788652195.382543:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:0.0:1788652195.382557:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:0.0:1788652195.382573:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:0.0:1788652195.382586:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:0.0:1788652195.382599:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:0.0:1788652195.382611:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:0.0:1788652195.382966:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:0.0:1788652195.382989:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788652195.383003:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:0.0:1788652195.383020:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:0.0:1788652195.383063:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652195.383111:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.383140:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c300 going to sleep for 11 seconds 00000100:00100000:2.0:1788652195.383411:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147703040 00000100:00100000:2.0:1788652195.383418:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147703040 00000100:00100000:2.0:1788652195.383451:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788652195.383457:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+17:23483:x1875537147703040:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652195.383774:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+17:23483:x1875537147703040:12345-0@lo:502:mount.lustre.0 Request processed in 316us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652195.383782:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788652195.384491:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703040:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652195.384710:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788652195.384724:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788652195.388494:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652195.388509:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.388512:0:23497:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788652195.388520:0:23497:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86c92db800 00000020:00000080:2.0:1788652195.388523:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652195.388530:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652195.388532:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.388546:0:23497:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788652195.388550:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652195.388553:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.388554:0:23497:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788652195.388557:0:23497:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86c92db800 00000020:00000080:2.0:1788652195.388559:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652195.391359:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652195.391373:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.391375:0:23497:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788652195.391379:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652195.391384:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.391385:0:23497:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788652195.391391:0:23497:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86c92db800 00000020:00000080:2.0:1788652195.391393:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652195.391439:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652195.391442:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.391443:0:23497:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788652195.391446:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652195.391448:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.391449:0:23497:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788652195.391453:0:23497:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86c92db800 00000020:00000080:2.0:1788652195.391454:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652195.391494:0:23497:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652195.391497:0:23497:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652195.391498:0:23497:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788652195.391502:0:23497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:3.0:1788652195.395726:0:23483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788652195.395775:0:23483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788652195.395803:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c57fa expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.395815:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c57fa expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652195.395875:0:23483:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788652195.395878:0:23483:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f86c92db800 10000000:01000000:3.0:1788652195.395880:0:23483:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f86c92db800 10000000:01000000:3.0:1788652195.395884:0:23483:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788652195.395890:0:23483:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86c92db800 from 1 10000000:01000000:3.0:1788652195.395892:0:23483:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788652195.395947:0:23483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c5801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.395956:0:23483:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c5801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.395979:0:23483:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c5801 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652195.396004:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652195.396075:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652195.396115:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86e0285900 going to sleep for 11 seconds 00000100:00100000:2.0:1788652195.396366:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147703168 00000100:00100000:2.0:1788652195.396374:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147703168 00000100:00100000:2.0:1788652195.396732:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788652195.396743:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+17:23483:x1875537147703168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652195.396757:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652195.396771:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c5808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5801 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652195.396804:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c5808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5801 expref: 18 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652195.396814:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c5808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5801 expref: 18 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652195.396823:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc800, rc 0) 00000100:00100000:2.0:1788652195.396872:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+18:23483:x1875537147703168:12345-0@lo:101:mount.lustre.0 Request processed in 131us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652195.396878:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788652195.396970:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5db480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652195.396992:0:23483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c5801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5808 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652195.397001:0:23483:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c5801 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5808 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788652195.419149:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788652195.419476:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652195.419708:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788652195.419749:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788652195.419769:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788652195.419790:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788652195.419807:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788652195.419830:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788652195.419851:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788652195.419871:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788652195.419887:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788652195.419938:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788652195.419956:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788652195.419972:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788652195.419988:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788652195.420003:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788652195.420020:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788652195.420035:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788652195.420053:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788652195.420083:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788652195.420102:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788652195.420122:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788652195.420144:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788652195.420165:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788652195.420182:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788652195.420200:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788652195.420217:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788652195.420234:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788652195.420248:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788652195.420263:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788652195.420279:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788652195.420291:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788652195.420304:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788652195.420333:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788652195.420348:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788652195.420373:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788652195.420387:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788652195.420399:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788652195.420411:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788652195.420424:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788652195.420436:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788652195.420449:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788652195.420462:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788652195.420477:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788652195.420502:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788652195.420517:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788652195.420531:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788652195.420544:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788652195.420559:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788652195.420572:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788652195.420699:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788652195.420719:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788652195.420737:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788652195.420743:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788652195.420838:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652195.420931:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652195.420986:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652195.422455:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147703296 00000100:00100000:1.0:1788652195.422466:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147703296 00000100:00100000:1.0:1788652195.422519:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788652195.422528:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+18:23483:x1875537147703296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652195.423048:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+18:23483:x1875537147703296:12345-0@lo:501:mount.lustre.0 Request processed in 518us (2137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652195.423066:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788652195.433506:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652195.433576:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652195.433681:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652195.433734:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652195.433741:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147703424 00000100:00100000:3.0:1788652195.433750:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147703424 00000100:00100000:3.0:1788652195.433808:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788652195.433819:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+18:23483:x1875537147703424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652195.433957:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+18:23483:x1875537147703424:12345-0@lo:503:mount.lustre.0 Request processed in 140us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.433966:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788652195.434165:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703424:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788652195.434773:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788652195.434856:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652195.434997:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652195.435037:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652195.435084:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147703552 00000100:00100000:3.0:1788652195.435091:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147703552 00000100:00100000:3.0:1788652195.435134:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788652195.435142:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+18:23483:x1875537147703552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652195.435249:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+18:23483:x1875537147703552:12345-0@lo:502:mount.lustre.0 Request processed in 107us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.435257:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788652195.435403:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788652195.435597:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788652195.435758:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1788652195.435791:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1788652195.435808:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1788652195.435822:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1788652195.435836:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1788652195.435849:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1788652195.435862:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1788652195.435874:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788652195.435888:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1788652195.435901:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1788652195.435949:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1788652195.435964:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1788652195.435977:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1788652195.435990:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1788652195.436002:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1788652195.436014:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1788652195.436027:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1788652195.436053:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1788652195.436067:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1788652195.436081:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1788652195.436094:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1788652195.436107:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1788652195.436120:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1788652195.436134:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1788652195.436158:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1788652195.436171:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1788652195.436186:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1788652195.436199:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1788652195.436212:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1788652195.436227:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1788652195.436244:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1788652195.436255:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1788652195.436268:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1788652195.436299:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1788652195.436329:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1788652195.436344:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1788652195.436357:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1788652195.436370:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1788652195.436384:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1788652195.436396:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1788652195.436410:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1788652195.436424:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1788652195.436438:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1788652195.436451:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1788652195.436462:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1788652195.436475:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1788652195.436488:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1788652195.436535:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703680:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652195.436588:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.436648:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652195.436961:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147703680 00000100:00100000:2.0:1788652195.436969:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147703680 00000100:00100000:2.0:1788652195.437023:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788652195.437032:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+18:23483:x1875537147703680:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652195.437157:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+18:23483:x1875537147703680:12345-0@lo:502:mount.lustre.0 Request processed in 126us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652195.437171:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788652195.438900:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703680:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788652195.439539:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1788652195.439583:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1788652195.440766:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703808:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652195.440865:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.440966:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d9968e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652195.441050:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147703808 00000100:00100000:2.0:1788652195.441059:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147703808 00000100:00100000:2.0:1788652195.441110:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788652195.441118:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+18:23483:x1875537147703808:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652195.441226:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+18:23483:x1875537147703808:12345-0@lo:502:mount.lustre.0 Request processed in 108us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652195.441234:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788652195.441390:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147703808:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788652195.441446:0:23483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1788652195.441456:0:23483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788652195.448412:0:23502:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788652195.448432:0:23502:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8f86eebab380) 00000020:00000080:0.0:1788652195.448459:0:23502:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788652195.448570:0:23502:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86c92db800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788652195.448575:0:23502:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86c92db800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788652195.448577:0:23502:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86c92db800 3 00010000:00080000:0.0:1788652195.448611:0:23502:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f86dfa35000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.145@tcp at head 00010000:00010000:1.0:1788652195.450369:0:23502:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788652195.450588:0:23502:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788652195.450634:0:23502:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788652195.450646:0:23502:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcd2f56ea038c5816 00000100:00080000:1.0:1788652195.450657:0:23502:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788652195.450664:0:23502:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f86dfa35000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652195.450704:0:23502:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c348ce00 x1875537147703936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788652195.450736:0:23502:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788652195.454128:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875537147703936:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788652195.454229:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788652195.454298:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652195.454303:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652195.454305:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652195.454334:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788652195.454430:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147703936 00000100:00100000:0.0:1788652195.454438:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147703936 00000100:00100000:0.0:1788652195.454479:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788652195.454486:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875537147703936:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788652195.454514:0:22752:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 651 last 0 00000020:00000080:0.0:1788652195.454551:0:22752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcd2f56ea038c581d 00000004:00100000:0.0:1788652195.454565:0:22752:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788652195.454617:0:22752:0:(import.c:65:import_set_state_nolock()) ffff8f86dfa31800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652195.454739:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875537147703936:12345-0@lo:38:llog_process_th.0 Request processed in 251us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652195.454746:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788652195.454787:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f85c348ce00 x1875537147703936/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652205 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652195.454797:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788652195.454806:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788652195.454813:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788652195.454818:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788652195.454820:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86dfa35000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788652195.454826:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875537147703936:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788652195.456743:0:23502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1788652195.458377:0:23483:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788652195.458420:0:23483:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788652195.458440:0:23483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c5801 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5808 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.458451:0:23483:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c5801 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5808 expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788652195.458513:0:23483:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788652195.458516:0:23483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788652195.458517:0:23483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652195.458518:0:23483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652195.458520:0:23483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652195.458521:0:23483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652195.458522:0:23483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788652195.458524:0:23483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652195.458525:0:23483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788652195.458529:0:23483:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1788652195.458532:0:23483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788652195.458533:0:23483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788652195.458534:0:23483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652195.458535:0:23483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652195.458536:0:23483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652195.458538:0:23483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652195.458539:0:23483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788652195.458540:0:23483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652195.458541:0:23483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788652195.458573:0:23483:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788652195.458595:0:23483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147704064:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788652195.462148:0:23483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652195.462196:0:23483:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86e0285600 going to sleep for 11 seconds 00000100:00100000:3.0:1788652195.462225:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147704064 00000100:00100000:3.0:1788652195.462235:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147704064 00000100:00100000:3.0:1788652195.462280:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788652195.462288:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+18:23483:x1875537147704064:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788652195.462330:0:22745:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788652195.462344:0:22745:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788652195.475175:0:22730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788652195.476127:0:22745:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788652195.476147:0:22745:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788652195.476180:0:22766:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788652195.476185:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788652195.476219:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.476242:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da5000/0xcd2f56ea038c5728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5721 expref: 18 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.476250:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c57ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c57e5 expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.476257:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.476299:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c57ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c57e5 expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.476325:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c57ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c57e5 expref: 18 pid: 22744 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652195.476378:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147704192:0@lo:104: 00000100:00100000:1.0:1788652195.476449:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788652195.476657:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da5000/0xcd2f56ea038c5728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c5721 expref: 18 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652195.476666:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86e7da5000/0xcd2f56ea038c5728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c5721 expref: 18 pid: 22743 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652195.476673:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147704320:0@lo:104: 00000100:00100000:1.0:1788652195.476696:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652195.476712:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2b23b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652195.477071:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147704192 00000100:00100000:3.0:1788652195.477080:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147704192 00000100:00100000:3.0:1788652195.477113:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147704320 00000100:00100000:3.0:1788652195.477116:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147704320 00000100:00100000:3.0:1788652195.477138:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652195.477147:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f967659c-eb6d-423b-8189-3d2637ee2451+4:22766:x1875537147704192:12345-0@lo:104: 00010000:00010000:3.0:1788652195.477160:0:22734:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c57ec expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.477265:0:22734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788652195.477272:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f967659c-eb6d-423b-8189-3d2637ee2451+4:22766:x1875537147704192:12345-0@lo:104: Request processed in 127us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.477279:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652195.477295:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652195.477301:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f967659c-eb6d-423b-8189-3d2637ee2451+3:22766:x1875537147704320:12345-0@lo:104: 00010000:00010000:3.0:1788652195.477320:0:22734:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c5728 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.477356:0:22734:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788652195.477361:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f967659c-eb6d-423b-8189-3d2637ee2451+3:22766:x1875537147704320:12345-0@lo:104: Request processed in 61us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.477367:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788652195.477388:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788652195.477748:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c57ec expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.477757:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788652195.477762:0:22739:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c57ec expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.477771:0:22739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c57ec expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652195.477789:0:22739:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c57ec expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652195.477794:0:22739:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788652195.477834:0:22739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c57ec expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.477841:0:22739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652195.477863:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c57ec expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.477870:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc000/0xcd2f56ea038c57e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c57ec expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.477882:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652195.477885:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c5728 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.477891:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0031e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788652195.477894:0:22739:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c5728 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.477901:0:22739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c5728 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652195.478090:0:22739:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c5728 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652195.478095:0:22739:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788652195.478113:0:22739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5728 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.478118:0:22739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652195.478133:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5728 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.478139:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c5721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5728 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.478152:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652195.478153:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652195.478155:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652195.478161:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652195.478172:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147704448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652195.478208:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652195.479553:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f967659c-eb6d-423b-8189-3d2637ee2451:3637:1875537147704576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652195.479606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652195.479642:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147704448 00000100:00100000:3.0:1788652195.479650:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147704448 00010000:00010000:3.0:1788652195.479680:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c57ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c57e5 expref: 19 pid: 22744 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652195.479704:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147704576 00000100:00100000:3.0:1788652195.479707:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147704576 00010000:00010000:3.0:1788652195.479716:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da5000/0xcd2f56ea038c5728 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c5721 expref: 20 pid: 22743 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652195.479727:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652195.479733:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+20:3636:x1875537147704448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652195.479754:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652195.479759:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c57ec lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c57e5 expref: 20 pid: 22744 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.479770:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c57ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c57e5 expref: 20 pid: 22744 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.479788:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652195.479819:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+20:3636:x1875537147704448:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.479826:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652195.479841:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652195.479846:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+19:3637:x1875537147704576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652195.479852:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652195.479855:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da5000/0xcd2f56ea038c5728 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c5721 expref: 19 pid: 22743 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.479864:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da5000/0xcd2f56ea038c5728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c5721 expref: 19 pid: 22743 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.479874:0:22735:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.479884:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788652195.479897:0:22735:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004130654s 00010000:00010000:3.0:1788652195.479902:0:22735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.479933:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.479940:0:22735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.479947:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.479953:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652195.479958:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.479966:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.479974:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.479984:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652195.480008:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+19:3637:x1875537147704576:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.480014:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652195.480050:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147704448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652195.480073:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f967659c-eb6d-423b-8189-3d2637ee2451:3637:1875537147704576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652195.480095:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c57ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c57e5 expref: 18 pid: 22744 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652195.480115:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147704192:0@lo:104: 00010000:00010000:3.0:1788652195.480128:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5000/0xcd2f56ea038c5728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c5721 expref: 17 pid: 22743 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652195.480135:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147704320:0@lo:104: 00010000:00010000:3.0:1788652195.480149:0:22766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.480158:0:22766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.480163:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652195.480169:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5824 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652195.482334:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+16:23483:x1875537147704064:12345-0@lo:253:mount.lustre.0 Request processed in 20039us (20187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.482347:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788652195.482630:0:23483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:23483:1875537147704064:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788652195.482650:0:23483:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788652195.482653:0:23483:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788652195.482655:0:23483:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788652195.482656:0:23483:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652195.482657:0:23483:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652195.482659:0:23483:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652195.482660:0:23483:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652195.482662:0:23483:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788652195.482664:0:23483:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652195.482666:0:23483:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788652195.482682:0:23483:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:1.0:1788652195.492923:0:23483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1788652195.493023:0:23508:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1788652195.493029:0:23508:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788652195.493937:0:23509:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788652195.494107:0:23483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:1.0:1788652195.494985:0:23483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788652195.495023:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788652195.495434:0:23483:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788652195.495443:0:23483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788652195.495480:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652195.496462:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788652195.497027:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788652195.497057:0:23483:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788652195.497143:0:23483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652195.500453:0:23510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5db480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23510:1875537147704704:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788652195.500555:0:23510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652195.500599:0:23510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7eb40 going to sleep for 11 seconds 00000040:00080000:0.0:1788652195.500808:0:23509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652195.502899:0:23509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788652195.503014:0:23509:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788652195.503247:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147704704 00000100:00100000:2.0:1788652195.503258:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147704704 00000100:00100000:2.0:1788652195.503323:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652195.503333:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23510:x1875537147704704:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788652195.503474:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23510:x1875537147704704:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 142us (2920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652195.503482:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00080000:10000000:1.0:1788652195.504125:0:23483:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:0.0:1788652195.508584:0:23510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5db480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23510:1875537147704704:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788652195.508635:0:23510:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788652195.508691:0:23510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23510:1875537147704832:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788652195.508758:0:23510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.508787:0:23510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d9968d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652195.508875:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147704832 00000100:00100000:3.0:1788652195.508894:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147704832 00000100:00100000:3.0:1788652195.508981:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788652195.508992:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23510:x1875537147704832:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788652195.509142:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23510:x1875537147704832:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 151us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.509150:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788652195.510128:0:23510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23510:1875537147704832:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788652195.510205:0:23510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23510:1875537147704960:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788652195.510245:0:23510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.510268:0:23510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652195.510354:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147704960 00000100:00100000:3.0:1788652195.510361:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147704960 00000100:00100000:3.0:1788652195.510396:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652195.510405:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23510:x1875537147704960:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788652195.510464:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23510:x1875537147704960:12345-0@lo:900:lod0001_rec0000.0 Request processed in 58us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.510472:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00000004:3.0:1788652195.511126:0:23483:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00080000:0.0:1788652195.511674:0:23510:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f86efa37100 x1875537147704960/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788652211 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652195.511689:0:23510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23510:1875537147704960:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788652195.511747:0:23510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23510:1875537147705088:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788652195.511788:0:23510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652195.511806:0:23510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d9968e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652195.512684:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147705088 00000100:00100000:3.0:1788652195.512692:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147705088 00000100:00100000:3.0:1788652195.512741:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788652195.512750:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23510:x1875537147705088:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788652195.512847:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23510:x1875537147705088:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 97us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652195.512854:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788652195.513027:0:23510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37100 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23510:1875537147705088:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788652195.513075:0:23510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652195.515018:0:23510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788652195.515101:0:23510:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788652195.515106:0:23510:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:1.0:1788652195.518015:0:23483:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788652195.518061:0:23483:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa71c01caf988 00100000:10000000:1.0:1788652195.518071:0:23483:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788652195.528050:0:23483:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788652195.528094:0:23483:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788652195.528117:0:23483:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788652195.528141:0:23483:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788652195.534199:0:23483:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788652195.534448:0:23483:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788652195.618722:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00010000:00010000:3.0:1788652196.256334:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788652196.512636:0:23505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788652196.640196:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 10000000:01000000:0.0:1788652196.832982:0:22748:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788652196.832989:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86c92db800 from 12 10000000:01000000:0.0:1788652196.832993:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788652196.833038:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652196.833050:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652196.833062:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652196.833085:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147705216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652196.833162:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652196.833199:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2aa1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788652196.833376:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147705216 00000100:00100000:3.0:1788652196.833385:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147705216 00000100:00100000:3.0:1788652196.833438:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788652196.833446:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+16:22748:x1875537147705216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652196.833459:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652196.833480:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c5832 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c582b expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652196.833504:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c5832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c582b expref: 17 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652196.833515:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c5832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c582b expref: 17 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652196.833525:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502c00, rc 0) 00000100:00100000:3.0:1788652196.833564:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+17:22748:x1875537147705216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652196.833570:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788652196.833622:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147705216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652196.833635:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5832 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652196.833644:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5832 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652196.833691:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147705344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788652196.833718:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652196.833734:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000900 going to sleep for 11 seconds 00000100:00100000:3.0:1788652196.833757:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147705344 00000100:00100000:3.0:1788652196.833761:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147705344 00000100:00100000:3.0:1788652196.833779:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788652196.833785:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+17:22748:x1875537147705344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788652196.833797:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788652196.833815:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788652196.833818:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788652196.833878:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+17:22748:x1875537147705344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 92us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652196.833884:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788652196.833931:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147705344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788652196.833966:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788652196.833972:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5832 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652196.833981:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5832 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652196.833989:0:22748:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788652196.833991:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86f3c9f800 from 12 10000000:01000000:3.0:1788652196.833993:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788652196.834006:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652196.834013:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652196.834020:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652196.834030:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147705472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788652196.834053:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652196.834066:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000900 going to sleep for 11 seconds 00000100:00100000:3.0:1788652196.834077:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147705472 00000100:00100000:3.0:1788652196.834086:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147705472 00000100:00100000:3.0:1788652196.834108:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788652196.834114:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcefb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+17:22748:x1875537147705472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652196.834120:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652196.834128:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5839 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652196.834141:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5839 expref: 18 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652196.834149:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5839 expref: 18 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652196.834226:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502a00, rc 0) 00000100:00100000:3.0:1788652196.834258:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcefb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+18:22748:x1875537147705472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652196.834265:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788652196.834313:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147705472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652196.834326:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5840 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652196.834334:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5840 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652196.834375:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147705600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788652196.834406:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652196.834430:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652196.834447:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147705600 00000100:00100000:3.0:1788652196.834457:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147705600 00000100:00100000:3.0:1788652196.835076:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788652196.835084:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+18:22748:x1875537147705600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788652196.835267:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788652196.835280:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788652196.835292:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788652196.835359:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+18:22748:x1875537147705600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 277us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652196.835366:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788652196.835398:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147705600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788652196.835429:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788652196.835435:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5840 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652196.835443:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5840 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652197.281211:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788652197.538178:0:23505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788652197.664180:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00010000:00010000:3.0:1788652198.306685:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652198.689625:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00010000:00010000:3.0:1788652199.331599:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652199.712395:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00000001:02000400:0.0:1788652200.114629:0:23752:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788652200.354404:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652200.425452:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147705728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788652200.425529:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.425648:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147705728 00000100:00100000:1.0:1788652200.425658:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147705728 00000100:00100000:1.0:1788652200.425713:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788652200.425722:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147705728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788652200.425755:0:23492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788652200.425801:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147705728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.425809:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788652200.426089:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147705728:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788652200.736353:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 0 seconds 00000100:00080000:1.0:1788652200.928092:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788652200.928099:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788652200.928102:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652200.928115:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f85c3fbc000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652200.928139:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c348d880 x1875537147705984/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788652200.928178:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652200.928182:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652200.928185:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652200.928188:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652200.928213:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652200.928217:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652200.928219:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652200.928222:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788652200.928291:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147705984:0@lo:38:kworker.0 00000100:00100000:0.0:1788652200.928360:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652200.928474:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147705984 00000100:00100000:1.0:1788652200.928483:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147705984 00000100:00100000:1.0:1788652200.928532:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652200.928539:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875537147705984:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788652200.928568:0:22756:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 656 last 0 00000020:00000080:1.0:1788652200.928606:0:22756:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c5847 00000004:00100000:1.0:1788652200.928621:0:22756:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788652200.928627:0:22756:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788652200.928977:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147705856:0@lo:400:kworker.0 00000100:00100000:3.0:1788652200.929031:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652200.929060:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652200.929066:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147706112:0@lo:400:kworker.0 00000100:00100000:3.0:1788652200.929090:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652200.929115:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147705856 00000100:00100000:3.0:1788652200.929119:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147705856 00000100:00100000:3.0:1788652200.929148:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788652200.929163:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcefb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+18:3635:x1875537147705856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652200.929219:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcefb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+18:3635:x1875537147705856:12345-0@lo:400:kworker.0 Request processed in 55us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652200.929226:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788652200.929256:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147706112 00000100:00100000:3.0:1788652200.929259:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147706112 00000100:00100000:3.0:1788652200.929285:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652200.929293:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147706112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652200.929324:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147706112:12345-0@lo:400:kworker.0 Request processed in 33us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652200.929330:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788652200.929367:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f85c348e300 x1875537147706112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652200.929381:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147706112:0@lo:400:kworker.0 00000100:00100000:3.0:1788652200.929391:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147705856:0@lo:400:kworker.0 00000100:00100000:2.0:1788652200.930994:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147706240:0@lo:400:kworker.0 00000100:00100000:2.0:1788652200.931055:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652200.931839:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147706240 00000100:00100000:3.0:1788652200.931850:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147706240 00000100:00100000:3.0:1788652200.931936:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652200.931945:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147706240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652200.932003:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147706240:12345-0@lo:400:kworker.0 Request processed in 59us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652200.932019:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788652200.934871:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f85c348c380 x1875537147706240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652200.934891:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147706240:0@lo:400:kworker.0 00000100:00080000:1.0:1788652200.943278:0:22756:0:(import.c:65:import_set_state_nolock()) ffff8f86dfb5e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652200.943381:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1875537147705984:12345-0@lo:38:kworker.0 Request processed in 14839us (15019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.943402:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788652200.943645:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788652200.943655:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788652200.943661:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788652200.943664:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788652200.943687:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007c4a91e6): req@ffff8f86ff5d9500 x1875537147698944/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652200.943713:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147705984:0@lo:38:kworker.0 00000100:00100000:0.0:1788652200.943967:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788652200.943983:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147706368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788652200.944026:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652200.944150:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652200.944180:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788652200.944216:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147706368 00000100:00100000:1.0:1788652200.944223:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147706368 00000100:00100000:1.0:1788652200.944266:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147698944 00000100:00100000:1.0:1788652200.944280:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147698944 00000100:00100000:1.0:1788652200.944298:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652200.944306:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1875537147706368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788652200.944332:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652200.944382:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1875537147706368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.944388:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652200.944402:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788652200.944408:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22792:x1875537147698944:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788652200.944470:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22792:x1875537147698944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 61us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.944478:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788652200.944486:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22792:1875537147698944:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788652200.944523:0:22792:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788652200.944558:0:22792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ac380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22792:1875537147706496:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788652200.944589:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652200.944623:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4ac8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652200.944656:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147706496 00000100:00100000:1.0:1788652200.944661:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147706496 00000100:00100000:1.0:1788652200.944692:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788652200.944699:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22792:x1875537147706496:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788652200.944810:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22792:x1875537147706496:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 111us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.944816:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788652200.945201:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147706368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788652200.945877:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ac380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22792:1875537147706496:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788652200.945990:0:22792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22792:1875537147706624:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788652200.946035:0:22792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652200.946066:0:22792:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49efe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652200.946185:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147706624 00000100:00100000:1.0:1788652200.946191:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147706624 00000100:00100000:1.0:1788652200.946252:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788652200.946271:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22792:x1875537147706624:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788652200.946354:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22792:x1875537147706624:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 94us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652200.946361:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788652200.949904:0:22792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37480 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22792:1875537147706624:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788652200.950034:0:22792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652200.960061:0:22792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788652200.960160:0:22792:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:0.0:1788652200.960167:0:22792:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:1.0:1788652201.176575:0:23805:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788652201.177305:0:23805:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788652201.379271:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788652202.034932:0:23855:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788652202.035124:0:23855:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788652202.401160:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788652202.778713:0:23903:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcdf193420 20000000:00000080:0.0:1788652202.778734:0:23903:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f86df969c00 uarg=0000000000000000 20000000:01000000:0.0:1788652202.778784:0:23903:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788652202.778792:0:23903:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788652202.778798:0:23903:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788652202.779372:0:23904:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788652202.779662:0:23903:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788652202.785570:0:23903:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788652202.785693:0:23903:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.785721:0:23903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c1502400/0xcd2f56ea038c56f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c56f0 expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.785729:0:23903:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c57fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c57f3 expref: 17 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.785737:0:23903:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.785795:0:23903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c57fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c57f3 expref: 17 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.785812:0:23903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c57fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c57f3 expref: 17 pid: 22743 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652202.785830:0:23903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23903:1875537147706752:0@lo:104: 00000100:00100000:0.0:1788652202.786126:0:23903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652202.786200:0:23903:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c1502400/0xcd2f56ea038c56f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c56f0 expref: 17 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.786209:0:23903:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86c1502400/0xcd2f56ea038c56f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c56f0 expref: 17 pid: 22745 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652202.786218:0:23903:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa36d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23903:1875537147706880:0@lo:104: 00000100:00100000:2.0:1788652202.786993:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147706752 00000100:00100000:2.0:1788652202.787006:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147706752 00000100:00100000:2.0:1788652202.787064:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652202.787074:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+3:23903:x1875537147706752:12345-0@lo:104: 00010000:00010000:2.0:1788652202.787091:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c57fa expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652202.787190:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788652202.787197:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+3:23903:x1875537147706752:12345-0@lo:104: Request processed in 125us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652202.787204:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788652202.787283:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652202.787292:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c57fa expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.787299:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652202.787304:0:22738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c57fa expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.787313:0:22738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c57fa expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652202.787321:0:22738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c57fa expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652202.787326:0:22738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788652202.787370:0:22738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c57fa expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.787377:0:22738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652202.787401:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c57fa expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.787537:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c57f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c57fa expref: -99 pid: 23483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.787553:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652202.787556:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652202.787557:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652202.787586:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147707008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652202.787626:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652202.787682:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147707008 00000100:00100000:1.0:1788652202.787687:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147707008 00010000:00010000:1.0:1788652202.787709:0:22736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c57fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c57f3 expref: 18 pid: 22743 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652202.787736:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652202.787743:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f967659c-eb6d-423b-8189-3d2637ee2451+18:3635:x1875537147707008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652202.787754:0:22736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652202.787760:0:22736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c57fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c57f3 expref: 18 pid: 22743 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.787773:0:22736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c57fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c57f3 expref: 18 pid: 22743 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.787790:0:22736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652202.787820:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f967659c-eb6d-423b-8189-3d2637ee2451+18:3635:x1875537147707008:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652202.787827:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652202.787869:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147707008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652202.788084:0:23903:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652202.788119:0:23903:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f096bcc0 going to sleep for 11 seconds 00010000:00010000:0.0:1788652202.788131:0:23903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1502000/0xcd2f56ea038c57fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c57f3 expref: 17 pid: 22743 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652202.788143:0:23903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23903:1875537147706752:0@lo:104: 00000100:00100000:2.0:1788652202.788199:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147706880 00000100:00100000:2.0:1788652202.788203:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147706880 00000100:00100000:2.0:1788652202.788261:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788652202.788269:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+3:23903:x1875537147706880:12345-0@lo:104: 00010000:00010000:2.0:1788652202.788279:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c56f7 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652202.788339:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788652202.788344:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+3:23903:x1875537147706880:12345-0@lo:104: Request processed in 77us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652202.788352:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788652202.788399:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652202.788413:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c56f7 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788421:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0030400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652202.788425:0:22739:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c56f7 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788444:0:22739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c56f7 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652202.788450:0:22739:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c56f7 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652202.788455:0:22739:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788652202.788478:0:22739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c56f7 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788496:0:22739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652202.788510:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c56f7 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788516:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c0030400/0xcd2f56ea038c56f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c56f7 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788534:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652202.788535:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652202.788537:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652202.788546:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147707136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652202.788575:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652202.788604:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147707136 00000100:00100000:1.0:1788652202.788608:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147707136 00010000:00010000:1.0:1788652202.788625:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c1502400/0xcd2f56ea038c56f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c56f0 expref: 17 pid: 22745 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652202.788644:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652202.788651:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+17:3636:x1875537147707136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652202.788666:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652202.788670:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c1502400/0xcd2f56ea038c56f7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c56f0 expref: 17 pid: 22745 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788680:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c1502400/0xcd2f56ea038c56f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c56f0 expref: 17 pid: 22745 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788696:0:22735:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788705:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788721:0:22735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788728:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788735:0:22735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788741:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788747:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652202.788752:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788760:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788779:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652202.788788:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652202.788816:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+17:3636:x1875537147707136:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652202.788822:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652202.788852:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147707136:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652202.788970:0:23903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1502400/0xcd2f56ea038c56f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c56f0 expref: 16 pid: 22745 timeout: 758 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652202.788981:0:23903:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa36d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23903:1875537147706880:0@lo:104: 00010000:00010000:0.0:1788652202.789002:0:23903:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.789011:0:23903:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.789017:0:23903:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652202.789023:0:23903:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c584e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23903 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652203.424737:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788652204.192039:0:22748:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788652204.192048:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86c92db800 from 13 10000000:01000000:1.0:1788652204.192054:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788652204.192106:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652204.192118:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652204.192131:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652204.192169:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147707264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788652204.192240:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652204.192295:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788652204.192387:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147707264 00000100:00100000:0.0:1788652204.192395:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147707264 00000100:00100000:0.0:1788652204.192451:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788652204.192460:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+16:22748:x1875537147707264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652204.192474:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652204.192487:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c585c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5855 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652204.192530:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c585c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5855 expref: 17 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652204.192540:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c585c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5855 expref: 17 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652204.192561:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5a00, rc 0) 00000100:00100000:0.0:1788652204.192610:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+17:22748:x1875537147707264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652204.192618:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788652204.192759:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147707264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652204.192787:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c585c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652204.192809:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c585c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652204.192870:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147707392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652204.192897:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652204.192944:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788652204.192996:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147707392 00000100:00100000:3.0:1788652204.193002:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147707392 00000100:00100000:3.0:1788652204.193025:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788652204.193032:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcefac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+17:22748:x1875537147707392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652204.193156:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcefac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+17:22748:x1875537147707392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652204.193162:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788652204.193391:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147707392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652204.193418:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147707520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652204.193456:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652204.193513:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788652204.193760:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147707520 00000100:00100000:3.0:1788652204.193765:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147707520 00000100:00100000:3.0:1788652204.193839:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788652204.193847:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+17:22748:x1875537147707520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652204.193993:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+17:22748:x1875537147707520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652204.194000:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788652204.194071:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147707520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788652204.195382:0:23964:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788652204.195617:0:22748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788652204.195640:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788652204.195650:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c585c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652204.195661:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c585c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652204.195671:0:22748:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788652204.195674:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86f3c9f800 from 13 10000000:01000000:2.0:1788652204.195677:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652204.195712:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652204.195719:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652204.195729:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652204.195751:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147707648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652204.195804:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652204.195842:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788652204.195944:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147707648 00000100:00100000:0.0:1788652204.195951:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147707648 00000100:00100000:0.0:1788652204.195996:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788652204.196005:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+17:22748:x1875537147707648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652204.196017:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652204.196030:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5e00/0xcd2f56ea038c586a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5863 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652204.196052:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5e00/0xcd2f56ea038c586a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5863 expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652204.196063:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5e00/0xcd2f56ea038c586a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5863 expref: 18 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652204.196072:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5e00, rc 0) 00000100:00100000:0.0:1788652204.196119:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+18:22748:x1875537147707648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652204.196153:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788652204.196290:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147707648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652204.196311:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c586a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652204.196321:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c586a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652204.196373:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147707776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652204.196397:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652204.196418:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0480 going to sleep for 11 seconds 00000100:00100000:3.0:1788652204.196988:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147707776 00000100:00100000:3.0:1788652204.196993:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147707776 00000100:00100000:3.0:1788652204.197034:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788652204.197043:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+18:22748:x1875537147707776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652204.197229:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+18:22748:x1875537147707776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 187us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652204.197237:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788652204.197691:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147707776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652204.197734:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147707904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652204.198106:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652204.198131:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652204.198189:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147707904 00000100:00100000:0.0:1788652204.198194:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147707904 00000100:00100000:0.0:1788652204.198231:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788652204.198238:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcefa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+18:22748:x1875537147707904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652204.198317:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcefa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+18:22748:x1875537147707904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652204.198324:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788652204.198340:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147707904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788652204.199174:0:23965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788652204.199349:0:22748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788652204.199375:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788652204.199385:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c586a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652204.199396:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c586a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652204.453089:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788652204.897867:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788652205.024688:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652195/real 1788652195] req@ffff8f86ff5da300 x1875537147702144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652205 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652205.024723:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86ff5da300 x1875537147702144/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652205 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652205.024733:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652195/real 1788652195] req@ffff8f86ff5d8a80 x1875537147701888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652205 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652205.024743:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86ff5d8a80 x1875537147701888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652205 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788652205.024762:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3dc4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652205.024802:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788652205.024807:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147702144:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788652205.024813:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652205.024819:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788652205.024822:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147701888:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788652205.027772:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652205.027779:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652205.027790:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652205.027793:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652205.027821:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652205.027824:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788652205.027828:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652205.027836:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 651 00000100:00080000:1.0:1788652205.027842:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788652205.027849:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f86f67f2000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652205.027871:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c348ca80 x1875537147708416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788652205.027887:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652205.027890:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788652205.027892:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c3dc4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652205.027895:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 651 00000100:00080000:1.0:1788652205.027897:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788652205.027901:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f85c3dc4800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652205.027933:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c348d880 x1875537147708544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652205.027969:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147708288:0@lo:400:kworker.0 00000100:00100000:1.0:1788652205.028033:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652205.028085:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652205.028092:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147708672:0@lo:400:kworker.0 00000100:00100000:1.0:1788652205.028120:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652205.028174:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147708288 00000100:00100000:1.0:1788652205.028188:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147708288 00000100:00100000:1.0:1788652205.028234:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788652205.028242:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147708288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652205.028309:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147708288:12345-0@lo:400:kworker.0 Request processed in 67us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652205.028316:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788652205.028355:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147708288:0@lo:400:kworker.0 00000100:00100000:3.0:1788652205.035960:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147708160:0@lo:400:kworker.0 00000100:00100000:3.0:1788652205.036049:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652205.036121:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652205.036132:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147708672 00000100:00100000:1.0:1788652205.036141:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147708672 00000100:00100000:3.0:1788652205.036146:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147708032:0@lo:400:kworker.0 00000100:00100000:3.0:1788652205.036187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652205.036188:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147708160 00000100:00100000:1.0:1788652205.036191:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147708160 00000100:00100000:1.0:1788652205.036207:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652205.036215:0:22752:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788652205.036215:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147708672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652205.036223:0:22752:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788652205.036239:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147708032 00000100:00100000:3.0:1788652205.036242:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147708032 00000100:00100000:1.0:1788652205.036273:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147708672:12345-0@lo:400:kworker.0 Request processed in 58us (8151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652205.036280:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788652205.036280:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652205.036286:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1875537147708032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652205.036296:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652205.036302:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147708160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652205.036321:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1875537147708032:12345-0@lo:400:kworker.0 Request processed in 34us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652205.036324:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147708160:12345-0@lo:400:kworker.0 Request processed in 23us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652205.036327:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788652205.036330:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788652205.036368:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f85c348c380 x1875537147708672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652205.036382:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147708672:0@lo:400:kworker.0 00000100:00100000:3.0:1788652205.036427:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147708032:0@lo:400:kworker.0 00010000:00080000:3.0:1788652205.036438:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f85c348d180 x1875537147708160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652221 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652205.036446:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147708160:0@lo:400:kworker.0 00000100:00100000:0.0:1788652205.036934:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147708416:0@lo:8:kworker.0 00000400:00000100:0.0:1788652205.036967:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147708416 offset 0 length 520: 4 00000100:00100000:0.0:1788652205.036994:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147708544:0@lo:8:kworker.0 00000400:00000100:0.0:1788652205.037012:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147708544 offset 0 length 520: 4 00010000:00010000:1.0:1788652205.477632:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652205.538047:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147708800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788652205.538146:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652205.538299:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147708800 00000100:00100000:1.0:1788652205.538315:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147708800 00000100:00100000:1.0:1788652205.538374:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788652205.538384:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147708800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788652205.538419:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788652205.538470:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147708800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652205.538477:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788652205.538521:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147708800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788652206.057996:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147708928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788652206.058084:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652206.058158:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147708928 00000100:00100000:1.0:1788652206.058166:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147708928 00000100:00100000:1.0:1788652206.058214:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788652206.058223:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875537147708928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788652206.058257:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652206.058303:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875537147708928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652206.058310:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788652206.058358:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147708928:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788652206.496314:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652207.072179:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652192/real 1788652192] req@ffff8f86f67ae300 x1875537147700096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652207 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652207.072214:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86f67ae300 x1875537147700096/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652207 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652207.072223:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652192/real 1788652192] req@ffff8f86f67aea00 x1875537147700224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652207 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652207.072235:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86f67aea00 x1875537147700224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652207 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788652207.072258:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c373d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788652207.072276:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788652207.072281:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147700096:0@lo:8:kworker.0 00000100:00080000:2.0:1788652207.072287:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788652207.072291:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788652207.072313:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147700224:0@lo:8:kworker.0 00000100:00080000:1.0:1788652207.077780:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652207.077787:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788652207.077790:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c373d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652207.077799:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:1.0:1788652207.077805:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788652207.077812:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f85c373d800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652207.077850:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c348ed80 x1875537147709312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788652207.077866:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652207.077869:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788652207.077871:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652207.077875:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 648 00000100:00080000:1.0:1788652207.077877:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788652207.077881:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f85c3fbf000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652207.077893:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c348d180 x1875537147709440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788652207.077954:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652207.077958:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652207.077961:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652207.077965:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788652207.077995:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147709568:0@lo:400:kworker.0 00000100:00100000:1.0:1788652207.078055:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652207.078102:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652207.078107:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147709696:0@lo:400:kworker.0 00000100:00100000:1.0:1788652207.078130:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652207.078162:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147709568 00000100:00100000:1.0:1788652207.078169:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147709568 00000100:00100000:1.0:1788652207.078214:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652207.078223:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147709568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652207.078268:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147709568:12345-0@lo:400:kworker.0 Request processed in 46us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652207.078281:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788652207.078323:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f85c348f800 x1875537147709568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652207.078335:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147709568:0@lo:400:kworker.0 00000100:00100000:3.0:1788652207.079715:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147709184:0@lo:400:kworker.0 00000100:00100000:3.0:1788652207.079770:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652207.079820:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788652207.079826:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147709056:0@lo:400:kworker.0 00000100:00100000:3.0:1788652207.079856:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652207.079885:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147709824:0@lo:400:kworker.0 00000100:00100000:3.0:1788652207.079948:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652207.079980:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147709056 00000100:00100000:3.0:1788652207.079986:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147709056 00000100:00100000:3.0:1788652207.080027:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788652207.080035:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+18:3636:x1875537147709056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652207.080103:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+18:3636:x1875537147709056:12345-0@lo:400:kworker.0 Request processed in 69us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652207.080110:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788652207.080143:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147709824 00000100:00100000:3.0:1788652207.080147:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147709824 00000100:00100000:3.0:1788652207.080172:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788652207.080178:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147709824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652207.080208:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147709824:12345-0@lo:400:kworker.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652207.080214:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788652207.080245:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147709056:0@lo:400:kworker.0 00010000:00080000:3.0:1788652207.080258:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86f48d1f80 x1875537147709824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652207.080270:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147709824:0@lo:400:kworker.0 00000100:00100000:2.0:1788652207.080509:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147709696 00000100:00100000:2.0:1788652207.080515:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147709696 00000100:00100000:2.0:1788652207.080555:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147709184 00000100:00100000:2.0:1788652207.080558:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147709184 00000100:00100000:2.0:1788652207.080572:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788652207.080579:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147709696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652207.080640:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147709696:12345-0@lo:400:kworker.0 Request processed in 61us (2508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652207.080647:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788652207.080660:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788652207.080666:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875537147709184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652207.080697:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875537147709184:12345-0@lo:400:kworker.0 Request processed in 32us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652207.080703:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788652207.080730:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147709696:0@lo:400:kworker.0 00000100:00100000:2.0:1788652207.080752:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147709312:0@lo:8:kworker.0 00000400:00000100:2.0:1788652207.080779:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147709312 offset 0 length 520: 4 00000100:00100000:2.0:1788652207.080800:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147709440:0@lo:8:kworker.0 00000400:00000100:2.0:1788652207.080818:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147709440 offset 0 length 520: 4 00000100:00100000:2.0:1788652207.080849:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147709184:0@lo:400:kworker.0 00000001:00100000:0.0:1788652207.089420:0:23484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788652207.522022:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788652207.777114:0:23505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788652208.546400:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652209.568072:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788652209.716253:0:24252:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788652209.716258:0:24252:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788652209.716259:0:24252:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788652209.716427:0:24252:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f86dfa34000 00000020:01000004:0.0:1788652209.716445:0:24252:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788652209.716458:0:24252:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788652209.716472:0:24252:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f85c2930000) 00000020:00000080:0.0:1788652209.716487:0:24252:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788652209.768784:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788652209.769976:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788652209.770403:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788652209.771867:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788652209.772525:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788652209.772828:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788652209.773045:0:24252:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788652209.776338:0:24252:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788652209.776565:0:24252:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788652209.776579:0:24252:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788652209.776593:0:24252:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd2f56ea038c5878 00000020:01000004:3.0:1788652209.776607:0:24252:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788652209.776630:0:24252:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.145@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788652209.776634:0:24252:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788652209.776642:0:24252:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788652209.776647:0:24252:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788652209.776660:0:24252:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f86fcd719c0) 00000020:00000080:3.0:1788652209.776673:0:24252:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788652209.777946:0:24252:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788652209.778492:0:24252:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788652209.778499:0:24252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788652209.779574:0:24252:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788652209.779582:0:24252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788652209.783447:0:24252:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788652209.783460:0:24252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788652209.784867:0:24252:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788652209.785180:0:24252:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788652209.785187:0:24252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788652209.785667:0:24252:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788652209.785671:0:24252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788652209.811016:0:24252:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652209.811390:0:24252:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788652209.811398:0:24252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788652209.815964:0:24252:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788652209.815996:0:24252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788652209.817272:0:24252:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788652209.817284:0:24252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788652209.821104:0:24252:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788652209.821327:0:24252:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788652209.821334:0:24252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788652209.830563:0:24252:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788652209.830586:0:24252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788652209.876219:0:24252:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788652209.876455:0:24252:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788652209.876462:0:24252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788652209.886279:0:24252:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788652209.886306:0:24252:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788652209.889147:0:24252:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788652209.889186:0:24252:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788652209.889193:0:24252:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788652209.912275:0:24252:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788652209.912318:0:24252:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.145@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788652209.912323:0:24252:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788652209.912325:0:24252:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788652209.912326:0:24252:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652209.912328:0:24252:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652209.912330:0:24252:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652209.912331:0:24252:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652209.912333:0:24252:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788652209.912334:0:24252:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652209.912335:0:24252:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788652209.912339:0:24252:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788652209.912352:0:24252:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788652209.912353:0:24252:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788652209.912354:0:24252:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652209.912355:0:24252:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652209.912356:0:24252:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652209.912357:0:24252:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652209.912358:0:24252:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788652209.912363:0:24252:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652209.912364:0:24252:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788652209.912390:0:24252:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788652209.912409:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147709952:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788652209.912474:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.912520:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0968000 going to sleep for 11 seconds 00000100:00100000:0.0:1788652209.912582:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147709952 00000100:00100000:0.0:1788652209.912589:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147709952 00000100:00100000:0.0:1788652209.912675:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788652209.912684:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcefbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+18:24252:x1875537147709952:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788652209.912712:0:22743:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788652209.912716:0:22743:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788652209.912719:0:22743:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788652209.912993:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcefbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+18:24252:x1875537147709952:12345-0@lo:253:mount.lustre.0 Request processed in 309us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652209.913001:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788652209.913140:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147709952:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788652209.913151:0:24252:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788652209.913153:0:24252:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788652209.913155:0:24252:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788652209.913156:0:24252:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652209.913157:0:24252:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652209.913158:0:24252:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652209.913159:0:24252:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652209.913160:0:24252:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652209.913162:0:24252:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652209.913163:0:24252:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788652209.913183:0:24252:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f86dfa34000 from lustre-OST0000 10000000:01000000:2.0:1788652209.913208:0:24252:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788652209.913210:0:24252:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788652209.913217:0:24252:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f85c20fb380 local copy 00010000:00010000:2.0:1788652209.913227:0:24252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652209.913307:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652209.913334:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.913380:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147710080 00000100:00100000:2.0:1788652209.913382:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc180 going to sleep for 11 seconds 00000100:00100000:3.0:1788652209.913386:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147710080 00000100:00100000:3.0:1788652209.913413:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788652209.913421:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c239f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+18:24252:x1875537147710080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652209.913506:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c239f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+18:24252:x1875537147710080:12345-0@lo:501:mount.lustre.0 Request processed in 84us (169us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788652209.913514:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788652209.913546:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710080:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788652209.913559:0:24252:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788652209.913574:0:24252:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788652209.913580:0:24252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.913594:0:24252:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652209.913617:0:24252:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f86dfa34000 10000000:01000000:2.0:1788652209.913621:0:24252:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788652209.913625:0:24252:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788652209.913628:0:24252:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788652209.913632:0:24252:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788652209.913634:0:24252:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788652209.913653:0:24252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c5886 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.913662:0:24252:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c5886 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.913671:0:24252:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c5886 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652209.913682:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652209.913705:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652209.913758:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc180 going to sleep for 11 seconds 00000100:00100000:1.0:1788652209.913801:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147710208 00000100:00100000:1.0:1788652209.913805:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147710208 00000100:00100000:1.0:1788652209.913869:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788652209.913877:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+18:24252:x1875537147710208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652209.913886:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652209.913898:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c588d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5886 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.913933:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c588d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5886 expref: 19 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.913944:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c588d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5886 expref: 19 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.913952:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415000, rc 0) 00000100:00100000:1.0:1788652209.913987:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+19:24252:x1875537147710208:12345-0@lo:101:mount.lustre.0 Request processed in 111us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.913993:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788652209.914067:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652209.914081:0:24252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c5886 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c588d expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.914091:0:24252:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c5886 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c588d expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788652209.914931:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1788652209.915432:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652209.916814:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788652209.916851:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788652209.916865:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788652209.916877:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788652209.916888:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788652209.916899:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788652209.916931:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788652209.916945:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788652209.916959:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1788652209.916971:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1788652209.916984:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1788652209.916996:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1788652209.917021:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1788652209.917027:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1788652209.917137:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652209.917193:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652209.917234:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c326f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788652209.917419:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147710336 00000100:00100000:3.0:1788652209.917428:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147710336 00000100:00100000:3.0:1788652209.917472:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788652209.917481:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+19:24252:x1875537147710336:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652209.917603:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+19:24252:x1875537147710336:12345-0@lo:501:mount.lustre.0 Request processed in 122us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652209.917611:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788652209.917717:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652209.917746:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652209.918076:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652209.918108:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c326f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788652209.918165:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147710464 00000100:00100000:1.0:1788652209.918171:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147710464 00000100:00100000:1.0:1788652209.918237:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788652209.918245:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+19:24252:x1875537147710464:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652209.918903:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+19:24252:x1875537147710464:12345-0@lo:503:mount.lustre.0 Request processed in 655us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.918941:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788652209.919187:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710464:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788652209.919644:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788652209.919723:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652209.919770:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652209.919856:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c900d240 going to sleep for 11 seconds 00000100:00100000:0.0:1788652209.919894:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147710592 00000100:00100000:0.0:1788652209.919900:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147710592 00000100:00100000:0.0:1788652209.920071:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788652209.920079:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+19:24252:x1875537147710592:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652209.920524:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+19:24252:x1875537147710592:12345-0@lo:502:mount.lustre.0 Request processed in 445us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652209.920532:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788652209.920608:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652209.920776:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788652209.920800:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788652209.920810:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788652209.920822:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788652209.920834:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788652209.920845:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788652209.920858:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788652209.920869:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788652209.920881:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1788652209.920893:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1788652209.920904:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1788652209.920950:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1788652209.920973:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652209.921006:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652209.921050:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc180 going to sleep for 11 seconds 00000100:00100000:1.0:1788652209.921117:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147710720 00000100:00100000:1.0:1788652209.921122:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147710720 00000100:00100000:1.0:1788652209.921153:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788652209.921162:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+19:24252:x1875537147710720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652209.921236:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+19:24252:x1875537147710720:12345-0@lo:502:mount.lustre.0 Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.921244:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788652209.921265:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710720:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652209.921317:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788652209.921325:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788652209.923743:0:24269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788652209.923754:0:24269:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788652209.923761:0:24269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652209.923763:0:24269:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788652209.923770:0:24269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788652209.923789:0:24269:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f86fcd70000) 00000020:00000080:3.0:1788652209.923815:0:24269:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788652209.923823:0:24269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788652209.923964:0:24269:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86dfa34000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788652209.923973:0:24269:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788652209.923980:0:24269:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd2f56ea038c589b 00010000:00010000:3.0:1788652209.927759:0:24269:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788652209.928240:0:24269:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1788652209.929534:0:24269:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1788652209.930741:0:24269:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788652209.930754:0:24269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652209.930760:0:24269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652209.930762:0:24269:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788652209.930766:0:24269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788652209.930768:0:24269:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788652209.930770:0:24269:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788652209.930771:0:24269:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788652209.930772:0:24269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788652209.930774:0:24269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652209.930776:0:24269:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788652209.930778:0:24269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652209.930781:0:24269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652209.930782:0:24269:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788652209.930785:0:24269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788652209.930787:0:24269:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788652209.930789:0:24269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652209.930791:0:24269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652209.930792:0:24269:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788652209.930794:0:24269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652209.930797:0:24269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652209.930798:0:24269:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788652209.930801:0:24269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788652209.930827:0:24269:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652209.930830:0:24269:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652209.930836:0:24269:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788652209.930840:0:24269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788652209.932468:0:24252:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788652209.932512:0:24252:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788652209.932969:0:24252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c5886 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c588d expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.932984:0:24252:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c5886 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c588d expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652209.932992:0:24252:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86dfa34000 from 1 10000000:01000000:2.0:1788652209.932995:0:24252:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652209.933044:0:24252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.933058:0:24252:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.933070:0:24252:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652209.933094:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652209.933158:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652209.933205:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c900d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788652209.933256:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147710848 00000100:00100000:1.0:1788652209.933269:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147710848 00000100:00100000:1.0:1788652209.933316:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788652209.933326:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+19:24252:x1875537147710848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652209.933339:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652209.933461:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c58a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c58a2 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.933486:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c58a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c58a2 expref: 20 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.933498:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c58a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c58a2 expref: 20 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.933517:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414400, rc 0) 00000100:00100000:1.0:1788652209.933708:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+20:24252:x1875537147710848:12345-0@lo:101:mount.lustre.0 Request processed in 384us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.933716:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788652209.933781:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652209.933795:0:24252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c58a9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.933805:0:24252:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c58a9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788652209.936008:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788652209.936286:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652209.936455:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788652209.936479:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788652209.936492:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788652209.936505:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788652209.936517:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788652209.936528:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788652209.936540:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788652209.936553:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788652209.936578:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788652209.936593:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788652209.936622:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788652209.936638:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788652209.936642:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788652209.936711:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652209.936778:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652209.936875:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788652209.936998:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147710976 00000100:00100000:1.0:1788652209.937006:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147710976 00000100:00100000:1.0:1788652209.937078:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788652209.937089:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+20:24252:x1875537147710976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652209.937231:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+20:24252:x1875537147710976:12345-0@lo:501:mount.lustre.0 Request processed in 144us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.937239:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788652209.937301:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147710976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652209.937334:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652209.937371:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652209.937645:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788652209.937680:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147711104 00000100:00100000:1.0:1788652209.937684:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147711104 00000100:00100000:1.0:1788652209.937811:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788652209.937821:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c384d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+20:24252:x1875537147711104:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652209.937904:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c384d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+20:24252:x1875537147711104:12345-0@lo:503:mount.lustre.0 Request processed in 85us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.937933:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788652209.938025:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711104:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788652209.938397:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788652209.938459:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652209.938498:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652209.938522:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147711232 00000100:00100000:2.0:1788652209.938526:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147711232 00000100:00100000:2.0:1788652209.938548:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788652209.938554:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c384fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+20:24252:x1875537147711232:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652209.938621:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c384fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+20:24252:x1875537147711232:12345-0@lo:502:mount.lustre.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652209.938628:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788652209.938662:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c52a2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788652209.938676:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652209.938837:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788652209.938864:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788652209.938889:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788652209.938929:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788652209.938949:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788652209.938966:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788652209.938983:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788652209.939242:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788652209.939256:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788652209.939269:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788652209.939296:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788652209.939318:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652209.939358:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652209.939385:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147711360 00000100:00100000:2.0:1788652209.939390:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147711360 00000100:00100000:2.0:1788652209.939411:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788652209.939417:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c384f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+20:24252:x1875537147711360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652209.939476:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c384f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+20:24252:x1875537147711360:12345-0@lo:502:mount.lustre.0 Request processed in 58us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652209.939483:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788652209.939515:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c52a2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788652209.939526:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652209.939558:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788652209.939564:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788652209.940212:0:24273:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652209.940222:0:24273:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652209.940224:0:24273:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788652209.940230:0:24273:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86dfa34000 00000020:00000080:2.0:1788652209.940233:0:24273:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652209.940240:0:24273:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652209.940242:0:24273:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652209.940248:0:24273:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788652209.940251:0:24273:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652209.940253:0:24273:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652209.940255:0:24273:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788652209.940258:0:24273:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86dfa34000 00000020:00000080:2.0:1788652209.940260:0:24273:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652209.940295:0:24273:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652209.940298:0:24273:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652209.940299:0:24273:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788652209.940301:0:24273:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652209.940304:0:24273:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652209.940305:0:24273:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788652209.940308:0:24273:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86dfa34000 00000020:00000080:2.0:1788652209.940310:0:24273:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652209.940325:0:24273:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652209.940327:0:24273:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652209.940328:0:24273:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788652209.940331:0:24273:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652209.940333:0:24273:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652209.940334:0:24273:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788652209.940337:0:24273:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86dfa34000 00000020:00000080:2.0:1788652209.940339:0:24273:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652209.940357:0:24273:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652209.940359:0:24273:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652209.940360:0:24273:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788652209.940363:0:24273:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788652209.940473:0:24252:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788652209.940496:0:24252:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788652209.940508:0:24252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c58a9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652209.940520:0:24252:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c58a9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652209.940567:0:24252:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788652209.940569:0:24252:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f86dfa34000 10000000:01000000:3.0:1788652209.940572:0:24252:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f86dfa34000 10000000:01000000:3.0:1788652209.940576:0:24252:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788652209.940581:0:24252:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86dfa34000 from 1 10000000:01000000:3.0:1788652209.940585:0:24252:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788652209.940613:0:24252:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c58b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652209.940621:0:24252:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c58b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652209.940631:0:24252:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c58b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652209.940648:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652209.940686:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.940718:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788652209.940760:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147711488 00000100:00100000:2.0:1788652209.940765:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147711488 00000100:00100000:2.0:1788652209.940805:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788652209.940813:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f87020ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+20:24252:x1875537147711488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652209.940824:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652209.940839:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dca00/0xcd2f56ea038c58b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c58b0 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.940869:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dca00/0xcd2f56ea038c58b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c58b0 expref: 21 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.940881:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dca00/0xcd2f56ea038c58b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c58b0 expref: 21 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.940889:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dca00, rc 0) 00000100:00100000:2.0:1788652209.940943:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f87020ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147711488:12345-0@lo:101:mount.lustre.0 Request processed in 131us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652209.940951:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788652209.941093:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652209.941109:0:24252:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c58b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c58b7 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652209.941124:0:24252:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c58b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c58b7 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652209.945970:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788652209.946283:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652209.946500:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788652209.946532:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788652209.946555:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788652209.946575:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788652209.946593:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788652209.946610:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788652209.946627:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788652209.946647:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788652209.946665:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788652209.946681:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788652209.946699:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788652209.946728:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788652209.946746:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788652209.946758:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788652209.946774:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788652209.946790:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788652209.946805:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788652209.946821:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788652209.946836:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788652209.946853:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788652209.946872:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788652209.946889:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788652209.946972:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788652209.946993:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788652209.947006:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788652209.947018:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788652209.947058:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788652209.947089:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788652209.947106:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788652209.947123:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788652209.947136:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788652209.947153:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788652209.947174:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788652209.947194:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788652209.947212:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788652209.947233:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788652209.947251:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788652209.947268:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788652209.947287:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788652209.947304:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788652209.947318:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788652209.947336:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788652209.947356:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788652209.947396:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788652209.947416:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788652209.947432:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788652209.947448:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788652209.947463:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788652209.947597:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788652209.947619:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788652209.947639:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788652209.947644:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788652209.947743:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652209.947822:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.947875:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652209.947943:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147711616 00000100:00100000:2.0:1788652209.947953:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147711616 00000100:00100000:2.0:1788652209.948016:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788652209.948037:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147711616:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652209.948185:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147711616:12345-0@lo:501:mount.lustre.0 Request processed in 159us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652209.948194:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788652209.948426:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652209.948460:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711744:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652209.948500:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.948530:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb99c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652209.948586:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147711744 00000100:00100000:1.0:1788652209.948591:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147711744 00000100:00100000:1.0:1788652209.948624:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788652209.948633:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147711744:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652209.948715:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147711744:12345-0@lo:503:mount.lustre.0 Request processed in 82us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.948722:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788652209.949456:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711744:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788652209.949893:0:24252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652209.950063:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711872:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652209.950118:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.950152:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788652209.950241:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147711872 00000100:00100000:2.0:1788652209.950248:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147711872 00000100:00100000:2.0:1788652209.950310:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788652209.950319:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147711872:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652209.950437:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147711872:12345-0@lo:502:mount.lustre.0 Request processed in 118us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652209.950450:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788652209.950524:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147711872:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652209.950783:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788652209.950815:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788652209.950833:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788652209.950847:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788652209.950866:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788652209.950893:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788652209.950960:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788652209.950981:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788652209.950999:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788652209.951044:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788652209.951061:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788652209.951075:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788652209.951090:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788652209.951105:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788652209.951119:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788652209.951137:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788652209.951152:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788652209.951166:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788652209.951179:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788652209.951192:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788652209.951205:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788652209.951234:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788652209.951246:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788652209.951272:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788652209.951287:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788652209.951303:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788652209.951317:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788652209.951333:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788652209.951349:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788652209.951362:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788652209.951376:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788652209.951390:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788652209.951403:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788652209.951420:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788652209.951438:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788652209.951452:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788652209.951469:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788652209.951497:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788652209.951514:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788652209.951529:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788652209.951548:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788652209.951563:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788652209.951595:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788652209.951616:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788652209.951633:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788652209.951650:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788652209.951666:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788652209.951680:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788652209.951728:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147712000:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652209.951785:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.951825:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147712000 00000100:00100000:3.0:1788652209.951831:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147712000 00000100:00100000:3.0:1788652209.951876:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788652209.951891:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147712000:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652209.952008:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147712000:12345-0@lo:502:mount.lustre.0 Request processed in 119us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652209.952017:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788652209.952077:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9300 going to sleep for 11 seconds 00000100:00100000:3.0:1788652209.952097:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147712000:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652209.952268:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788652209.952291:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788652209.952313:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147712128:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652209.952347:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.952369:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9300 going to sleep for 11 seconds 00000100:00100000:1.0:1788652209.952738:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147712128 00000100:00100000:1.0:1788652209.952744:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147712128 00000100:00100000:1.0:1788652209.952790:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788652209.952801:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147712128:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652209.952938:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147712128:12345-0@lo:502:mount.lustre.0 Request processed in 139us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.952946:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788652209.952994:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147712128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788652209.953066:0:24252:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788652209.953077:0:24252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788652209.954550:0:24277:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788652209.954569:0:24277:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f85c20f8000) 00000020:00000080:1.0:1788652209.954595:0:24277:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788652209.954714:0:24277:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86dfa34000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788652209.954720:0:24277:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86dfa34000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788652209.954723:0:24277:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86dfa34000 3 00010000:00080000:1.0:1788652209.954833:0:24277:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c31c6000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.145@tcp at head 00010000:00010000:0.0:1788652209.962202:0:24277:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788652209.962504:0:24277:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788652209.962565:0:24277:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788652209.962578:0:24277:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcd2f56ea038c58c5 00000100:00080000:0.0:1788652209.962589:0:24277:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788652209.962595:0:24277:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f85c31c6000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652209.962632:0:24277:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86efa36d80 x1875537147712256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788652209.962732:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147712256:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788652209.962804:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788652209.962808:0:24277:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788652209.963142:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147712256 00000100:00100000:1.0:1788652209.963151:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147712256 00000100:00100000:1.0:1788652209.963209:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652209.963217:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147712256:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788652209.963241:0:22750:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:1.0:1788652209.963269:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd2f56ea038c58cc 00000004:00100000:1.0:1788652209.963284:0:22750:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788652209.963321:0:22750:0:(import.c:65:import_set_state_nolock()) ffff8f85c31c2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652209.963372:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875537147712256:12345-0@lo:38:llog_process_th.0 Request processed in 155us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.963392:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652209.963501:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147712384:0@lo:400:kworker.0 00000100:00080000:0.0:1788652209.963503:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652209.963514:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652209.963516:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652209.963519:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788652209.963534:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788652209.963566:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652209.963570:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652209.963573:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:2.0:1788652209.963576:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86efa34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147712512:0@lo:400:kworker.0 00000100:00080000:0.0:1788652209.963576:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788652209.963599:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652209.964626:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652209.964636:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147712640:0@lo:400:kworker.0 00000100:00100000:2.0:1788652209.964669:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.964690:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147712512 00000100:00100000:3.0:1788652209.964697:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147712512 00000100:00100000:2.0:1788652209.964702:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147712384 00000100:00100000:2.0:1788652209.964705:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147712384 00010000:00080000:1.0:1788652209.964823:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86efa36d80 x1875537147712256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652209.964894:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788652209.964903:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147712512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652209.964921:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788652209.964932:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788652209.964939:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788652209.964944:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788652209.964947:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c31c6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788652209.964953:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147712256:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788652209.964976:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147712512:12345-0@lo:400:kworker.0 Request processed in 74us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652209.964984:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788652209.965302:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147712640 00000100:00100000:2.0:1788652209.965306:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147712640 00000100:00100000:2.0:1788652209.965320:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788652209.965327:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147712384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652209.965362:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147712384:12345-0@lo:400:kworker.0 Request processed in 35us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652209.965369:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788652209.965381:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788652209.965387:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147712640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652209.965415:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147712640:12345-0@lo:400:kworker.0 Request processed in 28us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652209.965421:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788652209.965439:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147712768:0@lo:400:kworker.0 00000100:00100000:2.0:1788652209.965463:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652209.965502:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147712384:0@lo:400:kworker.0 00000100:00100000:2.0:1788652209.965527:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147712640:0@lo:400:kworker.0 00010000:00080000:2.0:1788652209.965538:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86efa34380 x1875537147712512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652209.965546:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86efa34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147712512:0@lo:400:kworker.0 00000100:00100000:2.0:1788652209.965575:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147712768 00000100:00100000:2.0:1788652209.965579:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147712768 00000100:00100000:2.0:1788652209.965602:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788652209.965609:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147712768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652209.965642:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147712768:12345-0@lo:400:kworker.0 Request processed in 34us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652209.965649:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788652209.965670:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f85c36b7100 x1875537147712768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652209.965679:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147712768:0@lo:400:kworker.0 00000020:01000004:3.0:1788652209.966206:0:24277:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788652209.966222:0:24277:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f86fcd74d40) 00000020:00000080:3.0:1788652209.966256:0:24277:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788652209.966335:0:24277:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86dfa34000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788652209.966340:0:24277:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86dfa34000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788652209.966342:0:24277:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86dfa34000 3 00010000:00080000:3.0:1788652209.966378:0:24277:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c29d1800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.145@tcp at head 00010000:00010000:3.0:1788652209.968764:0:24277:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788652209.971668:0:24277:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788652209.971716:0:24277:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788652209.971731:0:24277:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcd2f56ea038c58da 00000100:00080000:3.0:1788652209.971743:0:24277:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788652209.971749:0:24277:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f85c29d1800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652209.971787:0:24277:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff5daa00 x1875537147712896/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652209.972161:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875537147712896:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788652209.972245:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788652209.972450:0:24277:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788652209.972549:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652209.972555:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652209.972557:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652209.972560:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652209.972564:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652209.972567:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652209.972570:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652209.972573:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1788652209.972967:0:24277:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:3.0:1788652209.973163:0:24252:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788652209.973194:0:24252:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788652209.973212:0:24252:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c58b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c58b7 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652209.973235:0:24252:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c0031e00/0xcd2f56ea038c58b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c58b7 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788652209.973284:0:24252:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788652209.973286:0:24252:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788652209.973287:0:24252:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652209.973288:0:24252:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652209.973290:0:24252:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652209.973291:0:24252:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652209.973293:0:24252:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788652209.973295:0:24252:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652209.973296:0:24252:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788652209.973300:0:24252:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788652209.973303:0:24252:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788652209.973304:0:24252:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788652209.973306:0:24252:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652209.973307:0:24252:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652209.973312:0:24252:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652209.973313:0:24252:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652209.973314:0:24252:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788652209.973315:0:24252:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652209.973316:0:24252:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788652209.973337:0:24252:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788652209.973354:0:24252:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147713024:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788652209.973399:0:24252:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.973428:0:24252:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652209.973449:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147713024 00000100:00100000:3.0:1788652209.973456:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147713024 00000100:00100000:3.0:1788652209.973498:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788652209.973506:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147713024:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788652209.973532:0:22743:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788652209.973545:0:22743:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788652209.974017:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147712896 00000100:00100000:1.0:1788652209.974023:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147712896 00000100:00100000:1.0:1788652209.974061:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652209.974067:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875537147712896:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788652209.974095:0:23985:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 665 last 0 00000020:00000080:1.0:1788652209.974145:0:23985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcd2f56ea038c58e1 00000004:00100000:1.0:1788652209.974161:0:23985:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788652209.974198:0:23985:0:(import.c:65:import_set_state_nolock()) ffff8f85c31c6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652209.974484:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875537147712896:12345-0@lo:38:llog_process_th.0 Request processed in 414us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.974492:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788652209.974572:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86ff5daa00 x1875537147712896/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652209.974583:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788652209.974591:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788652209.974598:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788652209.974603:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788652209.974606:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c29d1800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788652209.974612:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875537147712896:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788652209.981696:0:22743:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788652209.981726:0:22743:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788652209.982005:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+21:24252:x1875537147713024:12345-0@lo:253:mount.lustre.0 Request processed in 8495us (8600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.982023:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788652209.982101:0:24252:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:24252:1875537147713024:0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788652209.982116:0:22766:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788652209.982118:0:24252:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 10000000:01000000:3.0:1788652209.982123:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000020:01000004:1.0:1788652209.982124:0:24252:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788652209.982127:0:24252:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788652209.982129:0:24252:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652209.982131:0:24252:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652209.982132:0:24252:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652209.982134:0:24252:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652209.982135:0:24252:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788652209.982137:0:24252:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652209.982139:0:24252:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:3.0:1788652209.982152:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:02000000:1.0:1788652209.982166:0:24252:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788652209.982169:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c5832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c582b expref: 20 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652209.982188:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5839 expref: 20 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652209.982195:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652209.982284:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c5839 expref: 20 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652209.982299:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5840 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c5839 expref: 20 pid: 22745 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652209.982312:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5daa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147713152:0@lo:104: 00000100:00100000:3.0:1788652209.982349:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788652209.982395:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c5832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c582b expref: 20 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652209.982405:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c5832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c582b expref: 20 pid: 22744 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652209.982413:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147713280:0@lo:104: 00000100:00100000:3.0:1788652209.982440:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652209.982454:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9900 going to sleep for 11 seconds 00000100:00100000:2.0:1788652209.982809:0:22733:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788652209.982836:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147713152 00000100:00100000:2.0:1788652209.982844:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147713152 00000100:00100000:2.0:1788652209.982876:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147713280 00000100:00100000:2.0:1788652209.982878:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147713280 00000100:00100000:2.0:1788652209.982891:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652209.982900:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+4:22766:x1875537147713152:12345-0@lo:104: 00010000:00010000:2.0:1788652209.982936:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c5840 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.982991:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788652209.983492:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+4:22766:x1875537147713152:12345-0@lo:104: Request processed in 98us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652209.983500:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652209.983519:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652209.983526:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fceffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+3:22766:x1875537147713280:12345-0@lo:104: 00010000:00010000:2.0:1788652209.983542:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c5832 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.983586:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788652209.983592:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fceffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+3:22766:x1875537147713280:12345-0@lo:104: Request processed in 67us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652209.983598:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788652209.983635:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652209.983641:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c5840 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.983648:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788652209.983652:0:22739:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c5840 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.983662:0:22739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c5840 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652209.983669:0:22739:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c5840 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652209.983675:0:22739:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652209.983713:0:22739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5840 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.983721:0:22739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652209.983743:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5840 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.983750:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c5839 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5840 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.983769:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652209.983773:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c5832 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.983778:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788652209.983781:0:22739:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c5832 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.983788:0:22739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c5832 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652209.983794:0:22739:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c5832 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652209.983799:0:22739:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652209.983822:0:22739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5832 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.983829:0:22739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652209.983849:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5832 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.983856:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c582b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5832 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.983868:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652209.983870:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652209.983872:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652209.983885:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147713408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652209.983944:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652209.983947:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f967659c-eb6d-423b-8189-3d2637ee2451:3637:1875537147713536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652209.983988:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652209.984090:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147713408 00000100:00100000:1.0:1788652209.984098:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147713408 00010000:00010000:3.0:1788652209.984120:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652209.984125:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5840 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c5839 expref: 21 pid: 22745 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652209.984164:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147713536 00000100:00100000:2.0:1788652209.984166:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5daa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147713152:0@lo:104: 00000100:00100000:1.0:1788652209.984169:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147713536 00010000:00010000:1.0:1788652209.984185:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c5832 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c582b expref: 22 pid: 22744 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652209.984187:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147713280:0@lo:104: 00000100:00100000:1.0:1788652209.984209:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788652209.984214:0:22766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652209.984218:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+22:3636:x1875537147713408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652209.984242:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652209.984248:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5840 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c5839 expref: 22 pid: 22745 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.984260:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c5839 expref: 22 pid: 22745 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.984287:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c5839 expref: 22 pid: 22745 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652209.984297:0:22737:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788652209.984301:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652209.984306:0:22737:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788652209.984341:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+21:3636:x1875537147713408:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.984350:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652209.984364:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652209.984374:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f4adb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+20:3637:x1875537147713536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652209.984383:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652209.984388:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c5832 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c582b expref: 20 pid: 22744 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.984398:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c5832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c582b expref: 20 pid: 22744 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.984409:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1502c00/0xcd2f56ea038c5832 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c582b expref: 20 pid: 22744 timeout: 765 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.984420:0:22735:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.984428:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788652209.984441:0:22735:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004130654s 00010000:00010000:1.0:1788652209.984445:0:22735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.984463:0:22735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.984472:0:22735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.984479:0:22735:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.984486:0:22735:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0031c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652209.984491:0:22735:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.984499:0:22735:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652209.985077:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147713408:0@lo:103:ldlm_bl.0 00000001:00000004:3.0:1788652209.985184:0:24252:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:2.0:1788652209.987242:0:22766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652209.987257:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.987663:0:22735:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.987677:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58e8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652209.987699:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652209.987792:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f4adb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+19:3637:x1875537147713536:12345-0@lo:103:ldlm_bl.0 Request processed in 3417us (3799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652209.987802:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788652209.987963:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f967659c-eb6d-423b-8189-3d2637ee2451:3637:1875537147713536:0@lo:103:ldlm_bl.0 00002000:00080000:3.0:1788652209.990533:0:24252:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788652209.990542:0:24252:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788652209.990597:0:24252:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788652209.990639:0:24252:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788652209.990657:0:24252:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788652209.990679:0:24252:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788652209.991533:0:24252:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788652209.991739:0:24252:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788652210.592481:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652210.656230:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652210.656253:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147713664:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788652210.656320:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652210.656374:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147713664 00000100:00100000:1.0:1788652210.656382:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147713664 00000100:00100000:1.0:1788652210.656426:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788652210.656446:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147713664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788652210.656481:0:23492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788652210.656525:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147713664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652210.656532:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788652210.656708:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147713664:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1788652210.972339:0:24332:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788652210.972591:0:24332:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788652211.172579:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652211.172602:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147713792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788652211.172670:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652211.180089:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147713792 00000100:00100000:1.0:1788652211.180105:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147713792 00000100:00100000:1.0:1788652211.180170:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788652211.180181:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147713792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788652211.180221:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652211.180306:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147713792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (7635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652211.180313:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788652211.181146:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147713792:0@lo:41:osp-pre-1-0.0 10000000:01000000:0.0:1788652211.300420:0:22748:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788652211.300430:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86c92db800 from 13 10000000:01000000:0.0:1788652211.300435:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788652211.300481:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652211.300494:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652211.300505:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652211.300536:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147713920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652211.300608:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652211.300658:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34d36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652211.300805:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147713920 00000100:00100000:3.0:1788652211.300814:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147713920 00000100:00100000:3.0:1788652211.300873:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788652211.300882:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+19:22748:x1875537147713920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652211.300896:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652211.300948:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c58ef expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652211.300975:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c58ef expref: 20 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652211.300988:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c58ef expref: 20 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652211.300998:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0031c00, rc 0) 00000100:00100000:3.0:1788652211.301052:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+20:22748:x1875537147713920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652211.301059:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788652211.301107:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147713920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652211.301133:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c58f6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652211.301143:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c58f6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652211.301192:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147714048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788652211.301224:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652211.301245:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9240 going to sleep for 11 seconds 00000100:00100000:3.0:1788652211.301257:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147714048 00000100:00100000:3.0:1788652211.301261:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147714048 00000100:00100000:3.0:1788652211.301283:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788652211.301289:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+20:22748:x1875537147714048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788652211.301303:0:22743:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788652211.301769:0:22743:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788652211.301774:0:22743:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788652211.301868:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+20:22748:x1875537147714048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 578us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652211.301876:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788652211.302068:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5db480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147714048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788652211.302129:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788652211.302137:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c58f6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652211.302145:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c58f6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652211.302154:0:22748:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788652211.302156:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86f3c9f800 from 13 10000000:01000000:0.0:1788652211.302159:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788652211.302180:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652211.302196:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652211.302205:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652211.302221:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147714176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652211.302250:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652211.302277:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34d3540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652211.302786:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147714176 00000100:00100000:3.0:1788652211.302793:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147714176 00000100:00100000:3.0:1788652211.302835:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788652211.302844:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+20:22748:x1875537147714176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652211.302854:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652211.302866:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c5904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c58fd expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652211.302886:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c5904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c58fd expref: 21 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652211.302903:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c5904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c58fd expref: 21 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652211.302987:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0030400, rc 0) 00000100:00100000:3.0:1788652211.303037:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+21:22748:x1875537147714176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652211.303042:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788652211.303082:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147714176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652211.303094:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5904 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652211.303102:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5904 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652211.303149:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147714304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788652211.303181:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652211.303761:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f096be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788652211.304712:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147714304 00000100:00100000:0.0:1788652211.304723:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147714304 00000100:00100000:0.0:1788652211.304777:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788652211.304785:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+21:22748:x1875537147714304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788652211.304806:0:22743:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788652211.308305:0:22743:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788652211.308315:0:22743:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1788652211.308611:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+21:22748:x1875537147714304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 3824us (5426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652211.308623:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788652211.308960:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147714304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788652211.309047:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788652211.309059:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5904 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652211.309069:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5904 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652211.617236:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652212.640209:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652213.665796:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788652214.113134:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788652214.693065:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788652215.264159:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652215.264166:0:24298:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652215.264169:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652215.264172:0:24298:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652215.264189:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652215.264207:0:24298:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652215.264210:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652215.264214:0:24298:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788652215.264275:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147714816:0@lo:400:kworker.0 00000100:00100000:3.0:1788652215.264351:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652215.264419:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788652215.264425:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147714432:0@lo:400:kworker.0 00000100:00100000:3.0:1788652215.264454:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652215.264477:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147714944:0@lo:400:kworker.0 00000100:00100000:3.0:1788652215.264502:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652215.264659:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147714560:0@lo:400:kworker.0 00000100:00100000:3.0:1788652215.264685:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652215.264712:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147715072:0@lo:400:kworker.0 00000100:00100000:3.0:1788652215.264732:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652215.264751:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788652215.264757:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147714688:0@lo:400:kworker.0 00000100:00100000:3.0:1788652215.264777:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652215.264790:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147715200:0@lo:400:kworker.0 00000100:00100000:3.0:1788652215.264808:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652215.264842:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147714816 00000100:00100000:3.0:1788652215.264850:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147714816 00000100:00100000:0.0:1788652215.265016:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788652215.265030:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147714816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652215.265093:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147714816:12345-0@lo:400:kworker.0 Request processed in 67us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652215.265101:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788652215.265127:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147714944 00000100:00100000:0.0:1788652215.265131:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147714944 00000100:00100000:0.0:1788652215.265162:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147715072 00000100:00100000:0.0:1788652215.265165:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147715072 00000100:00100000:0.0:1788652215.265194:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147714688 00000100:00100000:0.0:1788652215.265197:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147714688 00000100:00100000:0.0:1788652215.265207:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147715200 00000100:00100000:0.0:1788652215.265210:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147715200 00000100:00100000:0.0:1788652215.265223:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788652215.265229:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147714944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652215.265264:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147714944:12345-0@lo:400:kworker.0 Request processed in 35us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652215.265270:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788652215.265284:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788652215.265289:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147715072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652215.265321:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147715072:12345-0@lo:400:kworker.0 Request processed in 32us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652215.265327:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788652215.265338:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788652215.265344:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147714688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652215.265369:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147714688:12345-0@lo:400:kworker.0 Request processed in 26us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652215.265375:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788652215.265386:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788652215.265392:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147715200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652215.265419:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147715200:12345-0@lo:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652215.265425:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788652215.265461:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86ff5da300 x1875537147714688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652215.265482:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147714688:0@lo:400:kworker.0 00010000:00080000:0.0:1788652215.265499:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86ff5daa00 x1875537147715200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652215.265508:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147715200:0@lo:400:kworker.0 00010000:00080000:0.0:1788652215.265535:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86ff5d8a80 x1875537147715072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652215.265542:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147715072:0@lo:400:kworker.0 00010000:00080000:0.0:1788652215.265576:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86ff5da680 x1875537147714944/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652215.265585:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147714944:0@lo:400:kworker.0 00000100:00100000:0.0:1788652215.265598:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147714816:0@lo:400:kworker.0 00000100:00100000:3.0:1788652215.265719:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147714560 00000100:00100000:3.0:1788652215.265724:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147714560 00000100:00100000:3.0:1788652215.265749:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788652215.265755:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147714560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652215.265798:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147714560:12345-0@lo:400:kworker.0 Request processed in 43us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652215.265805:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788652215.265824:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147714432 00000100:00100000:3.0:1788652215.265828:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147714432 00000100:00100000:3.0:1788652215.265853:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788652215.265859:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:3635:x1875537147714432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652215.265891:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:3635:x1875537147714432:12345-0@lo:400:kworker.0 Request processed in 32us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652215.265897:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788652215.266140:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788652215.266145:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652215.266217:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147714560:0@lo:400:kworker.0 00000100:00100000:0.0:1788652215.266241:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147714432:0@lo:400:kworker.0 00010000:00010000:3.0:1788652215.712089:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652215.777496:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147715328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788652215.777586:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652215.777882:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147715328 00000100:00100000:1.0:1788652215.777892:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147715328 00000100:00100000:1.0:1788652215.777976:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788652215.777985:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147715328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788652215.778018:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788652215.778071:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147715328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652215.778079:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788652215.778137:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147715328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788652216.288049:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147715456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788652216.288116:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652216.288171:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147715456 00000100:00100000:1.0:1788652216.288179:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147715456 00000100:00100000:1.0:1788652216.288224:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788652216.288232:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147715456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788652216.288280:0:23492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652216.288337:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147715456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652216.288345:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788652216.288391:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147715456:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788652216.736085:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788652217.495837:0:24623:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788652217.761995:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788652218.017899:0:23505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788652218.772702:0:24676:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788652218.773035:0:24676:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788652218.785608:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788652219.705402:0:24726:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788652219.705739:0:24726:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788652219.814638:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652220.192058:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652205/real 1788652205] req@ffff8f85c348ca80 x1875537147708416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652220 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652220.192106:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f85c348ca80 x1875537147708416/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652220 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652220.192117:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652205/real 1788652205] req@ffff8f85c348d880 x1875537147708544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652220 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652220.192130:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f85c348d880 x1875537147708544/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652220 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788652220.192164:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652220.192190:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788652220.192195:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147708416:0@lo:8:kworker.0 00000100:00080000:1.0:1788652220.192200:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3dc4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652220.192224:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788652220.192227:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147708544:0@lo:8:kworker.0 00000100:00080000:3.0:1788652220.192509:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652220.192514:0:24298:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652220.192516:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652220.192519:0:24298:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652220.192551:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652220.192555:0:24298:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788652220.192557:0:24298:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652220.192562:0:24298:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 660 00000100:00080000:3.0:1788652220.192568:0:24298:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788652220.192575:0:24298:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f86f67f2000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652220.192604:0:24298:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86eeb51180 x1875537147716096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652220.192617:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652220.192620:0:24298:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788652220.192622:0:24298:0:(import.c:65:import_set_state_nolock()) ffff8f85c3dc4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652220.192625:0:24298:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 660 00000100:00080000:3.0:1788652220.192628:0:24298:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788652220.192632:0:24298:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f85c3dc4800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652220.192655:0:24298:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86eeb52300 x1875537147716224/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788652220.192849:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147715712:0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.192950:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652220.193005:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147716480:0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.193034:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652220.193059:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788652220.193076:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f967659c-eb6d-423b-8189-3d2637ee2451:3638:1875537147715584:0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.193105:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652220.193124:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147716352:0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.193155:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652220.193188:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147716480 00000100:00100000:2.0:1788652220.193197:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147716480 00000100:00100000:2.0:1788652220.193248:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147716352 00000100:00100000:2.0:1788652220.193251:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147716352 00000100:00100000:2.0:1788652220.193271:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788652220.193279:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147716480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.193328:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147716480:12345-0@lo:400:kworker.0 Request processed in 50us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652220.193335:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788652220.193351:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788652220.193356:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147716352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.193381:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147716352:12345-0@lo:400:kworker.0 Request processed in 25us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652220.193386:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788652220.193405:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788652220.193450:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeb50380 x1875537147716352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652220.193462:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147716352:0@lo:400:kworker.0 00010000:00080000:2.0:1788652220.193473:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeb53b80 x1875537147716480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652220.193496:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147716480:0@lo:400:kworker.0 00000100:00100000:0.0:1788652220.193786:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147715584 00000100:00100000:0.0:1788652220.193792:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147715584 00000100:00100000:0.0:1788652220.193846:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788652220.193854:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+21:3638:x1875537147715584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652220.193893:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+21:3638:x1875537147715584:12345-0@lo:400:kworker.0 Request processed in 41us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652220.193899:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788652220.194239:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f967659c-eb6d-423b-8189-3d2637ee2451:3638:1875537147715584:0@lo:400:kworker.0 00000100:00100000:3.0:1788652220.194314:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147715712 00000100:00100000:3.0:1788652220.194319:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147715712 00000100:00100000:3.0:1788652220.194361:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788652220.194368:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147715712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652220.194436:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147715712:12345-0@lo:400:kworker.0 Request processed in 69us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652220.194443:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788652220.194656:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147715840:0@lo:400:kworker.0 00000100:00100000:1.0:1788652220.194691:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652220.194723:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147716608:0@lo:400:kworker.0 00000100:00100000:1.0:1788652220.194744:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652220.194770:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652220.194776:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147715968:0@lo:400:kworker.0 00000100:00100000:1.0:1788652220.194799:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652220.194828:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147715968 00000100:00100000:1.0:1788652220.194842:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147715968 00000100:00100000:1.0:1788652220.194872:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788652220.194880:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147715968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652220.194937:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147715968:12345-0@lo:400:kworker.0 Request processed in 58us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652220.194943:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788652220.194973:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147715968:0@lo:400:kworker.0 00000100:00100000:1.0:1788652220.194993:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147716096:0@lo:8:kworker.0 00000100:00100000:1.0:1788652220.195019:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652220.195043:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147716224:0@lo:8:kworker.0 00000100:00100000:1.0:1788652220.195064:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652220.195276:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147715840 00000100:00100000:0.0:1788652220.195281:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147715840 00000100:00100000:0.0:1788652220.195313:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147716608 00000100:00100000:0.0:1788652220.195315:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147716608 00000100:00100000:0.0:1788652220.195340:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788652220.195347:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147715840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652220.195391:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147715840:12345-0@lo:400:kworker.0 Request processed in 44us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652220.195397:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788652220.195410:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652220.195430:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147716608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652220.195458:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147716608:12345-0@lo:400:kworker.0 Request processed in 43us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652220.195463:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788652220.195484:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788652220.195504:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeb52a00 x1875537147715840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652220.195515:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147715840:0@lo:400:kworker.0 00010000:00080000:0.0:1788652220.195525:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeb50a80 x1875537147716608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652220.195533:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147716608:0@lo:400:kworker.0 00000100:00100000:2.0:1788652220.196108:0:24256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147716096 00000100:00100000:2.0:1788652220.196115:0:24256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147716096 00000100:00100000:2.0:1788652220.196142:0:24256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147716224 00000100:00100000:2.0:1788652220.196261:0:24256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147716224 00000100:00100000:2.0:1788652220.196288:0:24256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652220.196294:0:24256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875537147716096:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788652220.196321:0:24256:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 676 last 0 00000020:00000080:2.0:1788652220.196351:0:24256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c590b 00002000:00100000:2.0:1788652220.196365:0:24256:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f85c3441800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788652220.196370:0:24256:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788652220.196373:0:24256:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788652220.196791:0:24256:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788652220.196819:0:24256:0:(import.c:65:import_set_state_nolock()) ffff8f85c3446000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652220.196983:0:24256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875537147716096:12345-0@lo:8:kworker.0 Request processed in 686us (1962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652220.196991:0:24256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652220.197008:0:24256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652220.197012:0:24256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875537147716224:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788652220.197025:0:24256:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788652220.203279:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeb51180 x1875537147716096/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788652240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652220.203296:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788652220.203308:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788652220.203318:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788652220.203324:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788652220.203328:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788652220.203435:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788652220.203443:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147716096:0@lo:8:kworker.0 00000100:00100000:3.0:1788652220.203532:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147715712:0@lo:400:kworker.0 00000004:00080000:1.0:1788652220.203652:0:23493:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788652220.203747:0:23493:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 676138838254ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788652220.203753:0:23493:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1788652220.206299:0:23494:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788652220.206336:0:23494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23494:1875537147716864:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788652220.206347:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147716736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788652220.207334:0:23494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652220.207380:0:23494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652220.207393:0:24259:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788652220.207402:0:24259:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788652220.207488:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652220.207596:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147716736 00000100:00100000:3.0:1788652220.207825:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147716736 00000100:00080000:0.0:1788652220.207893:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652220.207903:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652220.207925:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1875537147716736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788652220.207960:0:24260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788652220.208020:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3636:x1875537147716736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652220.208027:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652220.208181:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147716864 00000100:00100000:3.0:1788652220.208186:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147716864 00000100:00100000:3.0:1788652220.208370:0:24745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652220.208378:0:24745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23494:x1875537147716864:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:0.0:1788652220.208963:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36b4a80 x1875537147716736/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652236 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652220.208986:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147716736:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788652220.209522:0:23484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1788652220.210818:0:24745:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788652220.210826:0:24745:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788652220.211535:0:24745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23494:x1875537147716864:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3151us (4197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652220.211546:0:24745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788652220.211754:0:23494:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36b5180 x1875537147716864/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788652236 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652220.211774:0:23494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23494:1875537147716864:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788652220.211788:0:23494:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788652220.211842:0:23494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23494:1875537147716992:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788652220.211886:0:23494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652220.211938:0:23494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652220.212004:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147716992 00000100:00100000:3.0:1788652220.212012:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147716992 00000100:00100000:3.0:1788652220.212485:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652220.212507:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23494:x1875537147716992:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788652220.212536:0:24259:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788652220.212582:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23494:x1875537147716992:12345-0@lo:5:osp-pre-0-1.0 Request processed in 88us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652220.212605:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788652220.212718:0:23494:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36b5180 x1875537147716992/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788652236 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652220.212728:0:23494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23494:1875537147716992:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1788652220.212737:0:23494:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788652220.212764:0:23494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23494:1875537147717120:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788652220.212789:0:23494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652220.212811:0:23494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652220.213049:0:24745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147717120 00000100:00100000:3.0:1788652220.213055:0:24745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147717120 00000100:00100000:3.0:1788652220.213403:0:24745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652220.213412:0:24745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23494:x1875537147717120:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788652220.213715:0:24745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:2.0:1788652220.222851:0:24256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875537147716224:12345-0@lo:8:kworker.0 Request processed in 25818us (27766us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788652220.222864:0:24256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788652220.224343:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3dc4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652220.224353:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788652220.224357:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147716224:0@lo:8:kworker.0 00000001:00080000:1.0:1788652220.268614:0:24253:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788652220.268631:0:24253:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788652220.278291:0:24745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23494:x1875537147717120:12345-0@lo:5:osp-pre-0-1.0 Request processed in 64871us (65490us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788652220.278305:0:24745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788652220.279090:0:23494:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36b5180 x1875537147717120/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788652236 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652220.279103:0:23494:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788652220.279110:0:23494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23494:1875537147717120:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788652220.279125:0:23494:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:2.0:1788652220.279196:0:23494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23494:1875537147717248:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788652220.279243:0:23494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652220.279277:0:23494:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c81f7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788652220.279358:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147717248 00000100:00100000:1.0:1788652220.279365:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147717248 00000100:00100000:1.0:1788652220.279410:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652220.279427:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23494:x1875537147717248:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788652220.279488:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23494:x1875537147717248:12345-0@lo:900:osp-pre-0-1.0 Request processed in 70us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652220.279495:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788652220.279620:0:23494:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86f67aca80 x1875537147717248/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788652236 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652220.279631:0:23494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23494:1875537147717248:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788652220.842723:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652220.896216:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652220.896243:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147717376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652220.896328:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652220.896433:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147717376 00000100:00100000:1.0:1788652220.896442:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147717376 00000100:00100000:1.0:1788652220.896500:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788652220.896510:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147717376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788652220.896550:0:23492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788652220.896600:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147717376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652220.896608:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788652220.896701:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147717376:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652221.410659:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147717504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788652221.410734:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652221.410923:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147717504 00000100:00100000:1.0:1788652221.410932:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147717504 00000100:00100000:1.0:1788652221.410989:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788652221.410999:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147717504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788652221.411033:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652221.411097:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147717504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652221.411105:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788652221.412348:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147717504:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788652221.859280:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652222.881007:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652223.905512:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788652224.354045:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788652224.939580:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652225.504174:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788652225.504198:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147717632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788652225.504266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652225.504464:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147717632 00000100:00100000:1.0:1788652225.504475:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147717632 00000100:00100000:1.0:1788652225.504546:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652225.504557:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147717632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788652225.504588:0:24260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788652225.504818:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147717632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 262us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652225.504826:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788652225.504872:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36b4000 x1875537147717632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652241 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652225.504891:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147717632:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788652225.505126:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788652225.506066:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652225.506071:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788652225.506074:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652225.506077:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788652225.506092:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652225.506096:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788652225.506100:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c3dc4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788652225.506106:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 676 00000100:00080000:2.0:1788652225.506249:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788652225.506257:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f85c3dc4800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652225.506295:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f67aca80 x1875537147718272/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788652225.506367:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147717888:0@lo:400:kworker.0 00000100:00100000:2.0:1788652225.506424:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652225.506473:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147718528:0@lo:400:kworker.0 00000100:00100000:2.0:1788652225.506498:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652225.506521:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788652225.506528:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147718016:0@lo:400:kworker.0 00000100:00100000:2.0:1788652225.506549:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652225.506566:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147718656:0@lo:400:kworker.0 00000100:00100000:2.0:1788652225.506588:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652225.506617:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147718272:0@lo:8:kworker.0 00000100:00100000:2.0:1788652225.506645:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652225.506676:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147717888 00000100:00100000:2.0:1788652225.506682:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147717888 00000100:00100000:2.0:1788652225.506720:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788652225.506740:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147717888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652225.506791:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147717888:12345-0@lo:400:kworker.0 Request processed in 63us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652225.506798:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788652225.506819:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147718528 00000100:00100000:2.0:1788652225.506823:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147718528 00000100:00100000:2.0:1788652225.506854:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147718016 00000100:00100000:2.0:1788652225.506857:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147718016 00000100:00100000:2.0:1788652225.506866:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147718656 00000100:00100000:2.0:1788652225.506868:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147718656 00000100:00100000:2.0:1788652225.506881:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788652225.506887:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147718528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652225.506936:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147718528:12345-0@lo:400:kworker.0 Request processed in 48us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652225.506942:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788652225.506959:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788652225.506964:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147718016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652225.506990:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147718016:12345-0@lo:400:kworker.0 Request processed in 26us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652225.506995:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788652225.507005:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788652225.507009:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147718656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652225.507030:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147718656:12345-0@lo:400:kworker.0 Request processed in 21us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652225.507035:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788652225.507068:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147718272 00000100:00100000:2.0:1788652225.507072:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147718272 00000100:00100000:2.0:1788652225.507091:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652225.507095:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875537147718272:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788652225.507188:0:24259:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788652225.507236:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875537147718272:12345-0@lo:8:kworker.0 Request processed in 139us (590us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788652225.507242:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788652225.507272:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86f67aea00 x1875537147718016/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652225.507284:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147718016:0@lo:400:kworker.0 00010000:00080000:2.0:1788652225.507293:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36f6d80 x1875537147718656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652225.507300:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147718656:0@lo:400:kworker.0 00000100:00100000:2.0:1788652225.507307:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147717888:0@lo:400:kworker.0 00010000:00080000:2.0:1788652225.507321:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36f6680 x1875537147718528/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652225.507329:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147718528:0@lo:400:kworker.0 00000100:00080000:2.0:1788652225.507355:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788652225.507359:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788652225.507377:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3dc4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788652225.507382:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788652225.507384:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147718272:0@lo:8:kworker.0 00000100:00100000:3.0:1788652225.507810:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147718144:0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.507850:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652225.507882:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788652225.507890:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147717760:0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.507934:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652225.507957:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147718400:0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.507975:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652225.507999:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147717760 00000100:00100000:3.0:1788652225.508003:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147717760 00000100:00100000:3.0:1788652225.508043:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788652225.508050:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+21:3635:x1875537147717760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652225.508090:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+21:3635:x1875537147717760:12345-0@lo:400:kworker.0 Request processed in 41us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652225.508097:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788652225.508129:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147717760:0@lo:400:kworker.0 00000100:00100000:0.0:1788652225.508194:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147718144 00000100:00100000:0.0:1788652225.508199:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147718144 00000100:00100000:0.0:1788652225.508235:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788652225.508242:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147718144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652225.508289:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147718144:12345-0@lo:400:kworker.0 Request processed in 48us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652225.508481:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788652225.508516:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147718144:0@lo:400:kworker.0 00000100:00100000:2.0:1788652225.514333:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147718400 00000100:00100000:2.0:1788652225.514349:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147718400 00000100:00100000:2.0:1788652225.514420:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788652225.514430:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147718400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652225.514526:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147718400:12345-0@lo:400:kworker.0 Request processed in 98us (6548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652225.514533:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788652225.520564:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36f4380 x1875537147718400/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652225.520586:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147718400:0@lo:400:kworker.0 00010000:00010000:1.0:1788652225.952257:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652226.016157:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652226.016181:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147718784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652226.016250:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652226.016300:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147718784 00000100:00100000:3.0:1788652226.016310:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147718784 00000100:00100000:3.0:1788652226.016359:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788652226.016367:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147718784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788652226.016400:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788652226.016859:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147718784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 491us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652226.016868:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788652226.017003:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147718784:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1788652226.503899:0:25073:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788652226.503903:0:25073:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788652226.505646:0:25073:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788652226.505942:0:25073:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f85c3727800 00000020:01000004:3.0:1788652226.505962:0:25073:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788652226.505978:0:25073:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788652226.505993:0:25073:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f86fcd73380) 00000020:00000080:3.0:1788652226.506013:0:25073:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00000100:00100000:2.0:1788652226.529821:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147718912:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788652226.529894:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.529965:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147718912 00000100:00100000:2.0:1788652226.529974:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147718912 00000100:00100000:2.0:1788652226.530622:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788652226.530631:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147718912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788652226.530658:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788652226.530772:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147718912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652226.530779:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788652226.530844:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147718912:0@lo:41:osp-pre-1-0.0 00100000:10000000:2.0:1788652226.556351:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788652226.559286:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788652226.559455:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788652226.559756:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788652226.559999:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788652226.560304:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788652226.560515:0:25073:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788652226.562215:0:25073:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788652226.562432:0:25073:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788652226.562446:0:25073:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788652226.562459:0:25073:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd2f56ea038c5919 00000020:01000004:3.0:1788652226.562466:0:25073:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788652226.562488:0:25073:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.145@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788652226.562491:0:25073:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788652226.562497:0:25073:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788652226.562523:0:25073:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788652226.562527:0:25073:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788652226.577562:0:25073:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788652226.577606:0:25073:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.145@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788652226.577611:0:25073:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788652226.577613:0:25073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788652226.577614:0:25073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652226.577616:0:25073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652226.577618:0:25073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652226.577619:0:25073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652226.577620:0:25073:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788652226.577622:0:25073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652226.577624:0:25073:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788652226.577627:0:25073:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788652226.577630:0:25073:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788652226.577631:0:25073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788652226.577632:0:25073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652226.577633:0:25073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652226.577635:0:25073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652226.577636:0:25073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652226.577637:0:25073:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788652226.577638:0:25073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652226.577639:0:25073:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788652226.577667:0:25073:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788652226.577686:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719040:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788652226.577767:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652226.577874:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c23e1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788652226.577983:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147719040 00000100:00100000:2.0:1788652226.577993:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147719040 00000100:00100000:2.0:1788652226.578119:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788652226.578138:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:25073:x1875537147719040:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788652226.578181:0:22744:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788652226.578184:0:22744:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788652226.578188:0:22744:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788652226.578555:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:25073:x1875537147719040:12345-0@lo:253:mount.lustre.0 Request processed in 418us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652226.578563:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788652226.578721:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719040:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788652226.578733:0:25073:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788652226.578736:0:25073:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788652226.578737:0:25073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788652226.578738:0:25073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652226.578739:0:25073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652226.578741:0:25073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652226.578742:0:25073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652226.578743:0:25073:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788652226.578745:0:25073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652226.578746:0:25073:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788652226.578774:0:25073:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f85c3727800 from lustre-OST0001 10000000:01000000:1.0:1788652226.578813:0:25073:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788652226.578816:0:25073:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788652226.578824:0:25073:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f85c20fb380 local copy 00010000:00010000:1.0:1788652226.578835:0:25073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652226.578966:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719168:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652226.579001:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652226.579333:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788652226.579426:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147719168 00000100:00100000:3.0:1788652226.579441:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147719168 00000100:00100000:1.0:1788652226.579530:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788652226.579538:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+21:25073:x1875537147719168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652226.579616:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+21:25073:x1875537147719168:12345-0@lo:501:mount.lustre.0 Request processed in 78us (613us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788652226.579623:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788652226.579704:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719168:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788652226.579731:0:25073:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788652226.579759:0:25073:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788652226.579766:0:25073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652226.579776:0:25073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c5633 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c563a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652226.579806:0:25073:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f85c3727800 10000000:01000000:3.0:1788652226.579811:0:25073:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788652226.579816:0:25073:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788652226.579818:0:25073:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788652226.579822:0:25073:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788652226.579825:0:25073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788652226.579849:0:25073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502c00/0xcd2f56ea038c5920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652226.579857:0:25073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1502c00/0xcd2f56ea038c5920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652226.579866:0:25073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1502c00/0xcd2f56ea038c5920 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652226.579880:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652226.579935:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652226.579953:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2b67600 going to sleep for 11 seconds 00000100:00100000:1.0:1788652226.579999:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147719296 00000100:00100000:1.0:1788652226.580003:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147719296 00000100:00100000:1.0:1788652226.580030:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788652226.580038:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+21:25073:x1875537147719296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652226.580046:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652226.580058:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff414c00/0xcd2f56ea038c5927 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5920 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.580081:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414c00/0xcd2f56ea038c5927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5920 expref: 22 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.580092:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff414c00/0xcd2f56ea038c5927 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5920 expref: 22 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.580113:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414c00, rc 0) 00000100:00100000:1.0:1788652226.580276:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+22:25073:x1875537147719296:12345-0@lo:101:mount.lustre.0 Request processed in 239us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652226.580283:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788652226.580358:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652226.580380:0:25073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1502c00/0xcd2f56ea038c5920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5927 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652226.580391:0:25073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502c00/0xcd2f56ea038c5920 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5927 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652226.581468:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1788652226.582302:0:25073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652226.584631:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788652226.584695:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788652226.584726:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788652226.584743:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788652226.584757:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788652226.584771:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788652226.584786:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788652226.584799:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788652226.584813:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1788652226.584839:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1788652226.584845:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1788652226.585221:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719424:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652226.585290:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652226.585372:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4ac8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788652226.585418:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147719424 00000100:00100000:3.0:1788652226.585427:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147719424 00000100:00100000:3.0:1788652226.585508:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788652226.585518:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+22:25073:x1875537147719424:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652226.585673:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+22:25073:x1875537147719424:12345-0@lo:501:mount.lustre.0 Request processed in 156us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652226.585681:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788652226.585776:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652226.585812:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652226.585853:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.586058:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c81f7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652226.586240:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147719552 00000100:00100000:1.0:1788652226.586247:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147719552 00000100:00100000:1.0:1788652226.586274:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788652226.586280:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+22:25073:x1875537147719552:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652226.586854:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+22:25073:x1875537147719552:12345-0@lo:503:mount.lustre.0 Request processed in 572us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652226.586862:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788652226.586961:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719552:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788652226.587403:0:25073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788652226.587482:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652226.587522:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.587603:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c81f7b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652226.587818:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147719680 00000100:00100000:1.0:1788652226.587830:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147719680 00000100:00100000:1.0:1788652226.587859:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788652226.587867:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+22:25073:x1875537147719680:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652226.588274:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+22:25073:x1875537147719680:12345-0@lo:502:mount.lustre.0 Request processed in 407us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652226.588281:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788652226.588365:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652226.588551:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788652226.588577:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788652226.588591:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788652226.588603:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788652226.588616:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788652226.588629:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788652226.588641:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788652226.588655:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788652226.588667:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788652226.588689:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652226.588736:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.588758:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c81f7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652226.588829:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147719808 00000100:00100000:3.0:1788652226.588835:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147719808 00000100:00100000:3.0:1788652226.588862:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788652226.588869:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+22:25073:x1875537147719808:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652226.588960:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+22:25073:x1875537147719808:12345-0@lo:502:mount.lustre.0 Request processed in 92us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652226.588968:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788652226.589066:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719808:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652226.589100:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788652226.589107:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788652226.589821:0:25077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788652226.589831:0:25077:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788652226.589838:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652226.589840:0:25077:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788652226.589846:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788652226.589860:0:25077:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f86fb24b380) 00000020:00000080:2.0:1788652226.589888:0:25077:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788652226.589894:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788652226.590006:0:25077:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f85c3727800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788652226.590015:0:25077:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788652226.590117:0:25077:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd2f56ea038c5935 00010000:00010000:1.0:1788652226.594450:0:25077:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788652226.594875:0:25077:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:1.0:1788652226.597922:0:25077:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788652226.602183:0:25077:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788652226.602197:0:25077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652226.602204:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652226.602206:0:25077:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788652226.602210:0:25077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652226.602215:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652226.602217:0:25077:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788652226.602220:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788652226.602222:0:25077:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788652226.602224:0:25077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652226.602226:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652226.602228:0:25077:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788652226.602230:0:25077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652226.602232:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652226.602233:0:25077:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788652226.602237:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788652226.602268:0:25077:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652226.602271:0:25077:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652226.602272:0:25077:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788652226.602276:0:25077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1788652226.607071:0:25073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788652226.607118:0:25073:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788652226.607142:0:25073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502c00/0xcd2f56ea038c5920 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5927 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.607157:0:25073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1502c00/0xcd2f56ea038c5920 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5927 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652226.607165:0:25073:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f85c3727800 from 1 10000000:01000000:2.0:1788652226.607168:0:25073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652226.607209:0:25073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.607218:0:25073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.607230:0:25073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652226.607256:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652226.607317:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.607354:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c81f7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788652226.607464:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147719936 00000100:00100000:3.0:1788652226.607473:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147719936 00000100:00100000:3.0:1788652226.607562:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788652226.607572:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+22:25073:x1875537147719936:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652226.607585:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652226.607597:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5943 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c593c expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652226.607631:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c593c expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652226.607642:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c593c expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652226.607652:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502a00, rc 0) 00000100:00100000:3.0:1788652226.607700:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+23:25073:x1875537147719936:12345-0@lo:101:mount.lustre.0 Request processed in 130us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652226.607717:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788652226.607786:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147719936:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652226.607800:0:25073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5943 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.607810:0:25073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5943 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652226.611159:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788652226.611434:0:25073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652226.612001:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788652226.612035:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788652226.612154:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788652226.612171:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788652226.612184:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788652226.612196:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788652226.612208:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788652226.612220:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788652226.612241:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788652226.612256:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788652226.612271:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788652226.612291:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788652226.612296:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788652226.612387:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652226.612457:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652226.612554:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c60006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652226.612646:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147720064 00000100:00100000:1.0:1788652226.612655:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147720064 00000100:00100000:1.0:1788652226.612753:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788652226.612770:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+23:25073:x1875537147720064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652226.612886:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+23:25073:x1875537147720064:12345-0@lo:501:mount.lustre.0 Request processed in 117us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652226.612894:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788652226.613008:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652226.613057:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652226.613093:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652226.613404:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c60006c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652226.613442:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147720192 00000100:00100000:0.0:1788652226.613448:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147720192 00000100:00100000:0.0:1788652226.613485:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788652226.613493:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+23:25073:x1875537147720192:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652226.613726:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+23:25073:x1875537147720192:12345-0@lo:503:mount.lustre.0 Request processed in 233us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652226.613734:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788652226.613805:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720192:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788652226.614335:0:25073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652226.614401:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720320:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652226.614444:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652226.614474:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c60006c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652226.614601:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147720320 00000100:00100000:2.0:1788652226.614607:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147720320 00000100:00100000:2.0:1788652226.614672:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788652226.614681:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+23:25073:x1875537147720320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652226.614783:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+23:25073:x1875537147720320:12345-0@lo:502:mount.lustre.0 Request processed in 102us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652226.614792:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788652226.614851:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720320:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652226.615035:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788652226.615071:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788652226.615097:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788652226.615110:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788652226.615121:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788652226.615132:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788652226.615143:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788652226.615154:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788652226.615165:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788652226.615177:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788652226.615187:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788652226.615207:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652226.615240:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652226.615495:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c60006c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652226.617655:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147720448 00000100:00100000:1.0:1788652226.617671:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147720448 00000100:00100000:1.0:1788652226.617741:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788652226.617750:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+23:25073:x1875537147720448:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652226.617933:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+23:25073:x1875537147720448:12345-0@lo:502:mount.lustre.0 Request processed in 184us (2692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652226.617942:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788652226.618743:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720448:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652226.618838:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788652226.618852:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788652226.621790:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652226.621803:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652226.621806:0:25081:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788652226.621814:0:25081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f85c3727800 00000020:00000080:3.0:1788652226.621816:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652226.621824:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652226.621826:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652226.621828:0:25081:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788652226.621830:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652226.621832:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652226.621833:0:25081:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788652226.621836:0:25081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f85c3727800 00000020:00000080:3.0:1788652226.621838:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652226.621900:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652226.622004:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652226.622005:0:25081:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788652226.622009:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652226.622011:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652226.622012:0:25081:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788652226.622015:0:25081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f85c3727800 00000020:00000080:3.0:1788652226.622017:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652226.622036:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652226.622039:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652226.622040:0:25081:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788652226.622042:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652226.622055:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652226.622056:0:25081:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788652226.622060:0:25081:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f85c3727800 00000020:00000080:3.0:1788652226.622061:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652226.622082:0:25081:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652226.622084:0:25081:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652226.622086:0:25081:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788652226.622088:0:25081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788652226.625662:0:25073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788652226.625728:0:25073:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788652226.625744:0:25073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5943 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.625759:0:25073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5943 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652226.625828:0:25073:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788652226.625831:0:25073:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f85c3727800 10000000:01000000:2.0:1788652226.625834:0:25073:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f85c3727800 10000000:01000000:2.0:1788652226.625839:0:25073:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788652226.625844:0:25073:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f85c3727800 from 1 10000000:01000000:2.0:1788652226.625847:0:25073:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788652226.625888:0:25073:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd400/0xcd2f56ea038c594a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.625898:0:25073:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd400/0xcd2f56ea038c594a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.625925:0:25073:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd400/0xcd2f56ea038c594a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652226.625961:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720576:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652226.626026:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652226.626647:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147720576 00000100:00100000:3.0:1788652226.626663:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147720576 00000100:00100000:3.0:1788652226.626725:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788652226.626735:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+23:25073:x1875537147720576:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652226.626749:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652226.626761:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c1502800/0xcd2f56ea038c5951 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c594a expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652226.626787:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1502800/0xcd2f56ea038c5951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c594a expref: 24 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652226.626798:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c1502800/0xcd2f56ea038c5951 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c594a expref: 24 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652226.626808:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502800, rc 0) 00000100:00100000:2.0:1788652226.628668:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34d3b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652226.636737:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147720576:12345-0@lo:101:mount.lustre.0 Request processed in 9993us (10700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652226.636751:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788652226.638398:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720576:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652226.638430:0:25073:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd400/0xcd2f56ea038c594a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5951 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652226.638445:0:25073:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd400/0xcd2f56ea038c594a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5951 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652226.644209:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788652226.644562:0:25073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652226.644767:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788652226.644796:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788652226.644813:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788652226.644842:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788652226.644862:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788652226.644898:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788652226.644943:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788652226.644956:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788652226.644969:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788652226.644983:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788652226.644996:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788652226.645008:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788652226.645019:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788652226.645031:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788652226.645042:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788652226.645615:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788652226.646723:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788652226.646753:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788652226.646841:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788652226.646871:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788652226.646890:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788652226.646923:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788652226.646944:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788652226.646962:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788652226.646979:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788652226.646996:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788652226.647017:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788652226.647034:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788652226.647050:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788652226.647066:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788652226.647081:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788652226.647097:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788652226.647112:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788652226.647127:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788652226.647142:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788652226.647158:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788652226.647173:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788652226.647187:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788652226.647203:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788652226.647294:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788652226.647317:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788652226.647333:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788652226.647348:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788652226.647377:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788652226.647408:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788652226.647423:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788652226.647449:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788652226.647465:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788652226.648168:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788652226.648195:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788652226.648216:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788652226.648236:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788652226.648346:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652226.648426:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.648471:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34d3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788652226.650216:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147720704 00000100:00100000:0.0:1788652226.650234:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147720704 00000100:00100000:0.0:1788652226.650302:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788652226.650313:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147720704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652226.650498:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147720704:12345-0@lo:501:mount.lustre.0 Request processed in 187us (2073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652226.650507:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788652226.651162:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652226.651217:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720832:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652226.651269:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652226.651307:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c30fa180 going to sleep for 11 seconds 00000100:00100000:2.0:1788652226.651417:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147720832 00000100:00100000:2.0:1788652226.651424:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147720832 00000100:00100000:2.0:1788652226.651466:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788652226.651474:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147720832:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652226.651699:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147720832:12345-0@lo:503:mount.lustre.0 Request processed in 225us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652226.651716:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788652226.651796:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720832:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788652226.652984:0:25073:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788652226.653672:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652226.653748:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652226.653824:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c30fa180 going to sleep for 11 seconds 00000100:00100000:2.0:1788652226.655637:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147720960 00000100:00100000:2.0:1788652226.655652:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147720960 00000100:00100000:2.0:1788652226.655727:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788652226.655737:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147720960:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652226.656101:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147720960:12345-0@lo:502:mount.lustre.0 Request processed in 363us (2352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652226.656110:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788652226.656149:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147720960:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788652226.656349:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:1.0:1788652226.656376:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:1.0:1788652226.656389:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:1.0:1788652226.656400:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:1.0:1788652226.656419:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:1.0:1788652226.656430:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:1.0:1788652226.656443:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:1.0:1788652226.656454:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:1.0:1788652226.656466:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:1.0:1788652226.656477:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:1.0:1788652226.656489:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:1.0:1788652226.656500:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:1.0:1788652226.656512:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:1.0:1788652226.656537:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:1.0:1788652226.656566:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:1.0:1788652226.656579:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:1.0:1788652226.656591:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:1.0:1788652226.656602:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:1.0:1788652226.656614:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:1.0:1788652226.656625:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:1.0:1788652226.656636:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:1.0:1788652226.656647:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:1.0:1788652226.656658:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:1.0:1788652226.656670:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:1.0:1788652226.656681:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:1.0:1788652226.656692:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:1.0:1788652226.656704:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:1.0:1788652226.656731:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:1.0:1788652226.656743:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:1.0:1788652226.656754:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:1.0:1788652226.656776:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:1.0:1788652226.656788:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:1.0:1788652226.656799:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:1.0:1788652226.656810:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:1.0:1788652226.656822:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:1.0:1788652226.656833:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:1.0:1788652226.656845:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:1.0:1788652226.656863:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:1.0:1788652226.656874:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:1.0:1788652226.656886:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:1.0:1788652226.656897:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:1.0:1788652226.656942:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:1.0:1788652226.656957:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:1.0:1788652226.656970:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:1.0:1788652226.656981:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:1.0:1788652226.656993:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:1.0:1788652226.657014:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:1.0:1788652226.657027:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:1.0:1788652226.657183:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147721088:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652226.657232:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652226.657273:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c30fa180 going to sleep for 11 seconds 00000100:00100000:2.0:1788652226.657350:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147721088 00000100:00100000:2.0:1788652226.657356:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147721088 00000100:00100000:2.0:1788652226.657403:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788652226.657410:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147721088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652226.658152:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147721088:12345-0@lo:502:mount.lustre.0 Request processed in 739us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652226.658161:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788652226.658269:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147721088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788652226.658465:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788652226.658491:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788652226.658517:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147721216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652226.658689:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652226.658733:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788652226.658774:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147721216 00000100:00100000:2.0:1788652226.658780:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147721216 00000100:00100000:2.0:1788652226.658851:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788652226.658860:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147721216:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652226.658972:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147721216:12345-0@lo:502:mount.lustre.0 Request processed in 113us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652226.658979:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788652226.660587:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147721216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788652226.660682:0:25073:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788652226.660697:0:25073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788652226.661614:0:25086:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788652226.661632:0:25086:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f86fb248000) 00000020:00000080:2.0:1788652226.661656:0:25086:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788652226.661758:0:25086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f85c3727800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788652226.661763:0:25086:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f85c3727800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788652226.661766:0:25086:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f85c3727800 3 00010000:00080000:2.0:1788652226.661844:0:25086:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c354c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788652226.663801:0:25086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788652226.664082:0:25086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788652226.664123:0:25086:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788652226.664135:0:25086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcd2f56ea038c595f 00000100:00080000:2.0:1788652226.664146:0:25086:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652226.664152:0:25086:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f85c354c000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652226.664188:0:25086:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c36f4a80 x1875537147721344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652226.664232:0:25086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788652226.664263:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652226.664268:0:24298:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788652226.664271:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652226.664274:0:24298:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788652226.664313:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652226.664316:0:24298:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788652226.664318:0:24298:0:(import.c:65:import_set_state_nolock()) ffff8f85c3dc4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788652226.664322:0:24298:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 681 00000100:00080000:2.0:1788652226.664326:0:24298:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788652226.664329:0:24298:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f85c3dc4800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652226.664341:0:24298:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c36f7100 x1875537147721856/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788652226.664383:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147721472:0@lo:400:kworker.0 00000100:00100000:2.0:1788652226.664442:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.664472:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147722112:0@lo:400:kworker.0 00000100:00100000:2.0:1788652226.664494:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.664516:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788652226.664523:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147721600:0@lo:400:kworker.0 00000100:00100000:2.0:1788652226.664547:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.664564:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147722240:0@lo:400:kworker.0 00000100:00100000:2.0:1788652226.664583:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.664622:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147721728:0@lo:400:kworker.0 00000100:00100000:0.0:1788652226.664763:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147721344:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788652226.664796:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652226.664824:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147721856:0@lo:8:kworker.0 00000100:00100000:0.0:1788652226.664846:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652226.664878:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147721472 00000100:00100000:0.0:1788652226.664885:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147721472 00000100:00100000:0.0:1788652226.664953:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147722112 00000100:00100000:0.0:1788652226.664957:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147722112 00000100:00100000:0.0:1788652226.664970:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147722240 00000100:00100000:0.0:1788652226.664973:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147722240 00000100:00100000:0.0:1788652226.664983:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147721344 00000100:00100000:0.0:1788652226.664985:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147721344 00000100:00100000:0.0:1788652226.664998:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788652226.665008:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147721472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652226.665077:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147721472:12345-0@lo:400:kworker.0 Request processed in 71us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652226.665093:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788652226.665121:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788652226.665128:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147722112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652226.665162:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147722112:12345-0@lo:400:kworker.0 Request processed in 35us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652226.665168:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788652226.665182:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788652226.665189:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147722240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652226.665220:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147722240:12345-0@lo:400:kworker.0 Request processed in 32us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652226.665226:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788652226.665237:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788652226.665241:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3634:x1875537147721344:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788652226.665264:0:23985:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:0.0:1788652226.665297:0:23985:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd2f56ea038c5966 00000004:00100000:0.0:1788652226.665312:0:23985:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788652226.665347:0:23985:0:(import.c:65:import_set_state_nolock()) ffff8f85c3550000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652226.665391:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875537147721344:12345-0@lo:38:llog_process_th.0 Request processed in 147us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652226.665397:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788652226.665417:0:24745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147721856 00000100:00100000:0.0:1788652226.665422:0:24745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147721856 00000100:00100000:0.0:1788652226.665444:0:24745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788652226.665449:0:24745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3634:x1875537147721856:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788652226.665489:0:24745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3634:x1875537147721856:12345-0@lo:8:kworker.0 Request processed in 38us (641us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788652226.665503:0:24745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788652226.665541:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36f4a80 x1875537147721344/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652226.665550:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788652226.665558:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788652226.665566:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788652226.665571:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788652226.665573:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c354c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788652226.665579:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147721344:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788652226.665592:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788652226.665596:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3dc4800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652226.665600:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788652226.665602:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147721856:0@lo:8:kworker.0 00000100:00100000:2.0:1788652226.665805:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.665829:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652226.665837:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147721984:0@lo:400:kworker.0 00000100:00100000:2.0:1788652226.665862:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.665894:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147721984 00000100:00100000:2.0:1788652226.665898:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147721984 00000100:00100000:2.0:1788652226.665959:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788652226.665967:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147721984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652226.666010:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147721984:12345-0@lo:400:kworker.0 Request processed in 44us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652226.666016:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788652226.666057:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147721600 00000100:00100000:2.0:1788652226.666061:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147721600 00000100:00100000:2.0:1788652226.666089:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788652226.666095:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147721600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652226.666130:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147721600:12345-0@lo:400:kworker.0 Request processed in 35us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652226.666136:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788652226.666155:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147721728 00000100:00100000:2.0:1788652226.666159:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147721728 00000100:00100000:2.0:1788652226.666184:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652226.666190:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147721728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652226.666221:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147721728:12345-0@lo:400:kworker.0 Request processed in 31us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652226.666227:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652226.666257:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147721600:0@lo:400:kworker.0 00010000:00080000:2.0:1788652226.666281:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36f5500 x1875537147722240/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652226.666290:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147722240:0@lo:400:kworker.0 00010000:00080000:2.0:1788652226.666300:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36f6300 x1875537147721472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652226.666307:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147721472:0@lo:400:kworker.0 00010000:00080000:2.0:1788652226.666317:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36f5880 x1875537147722112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652226.666325:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147722112:0@lo:400:kworker.0 00010000:00080000:2.0:1788652226.666355:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36f4e00 x1875537147721984/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652226.666362:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147721984:0@lo:400:kworker.0 00010000:00080000:2.0:1788652226.666370:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c36f5f80 x1875537147721728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652242 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652226.666379:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147721728:0@lo:400:kworker.0 00000020:01000004:3.0:1788652226.666779:0:25086:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788652226.666795:0:25086:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f86ea1f0000) 00000020:00000080:3.0:1788652226.666817:0:25086:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788652226.666951:0:25086:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f85c3727800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788652226.666956:0:25086:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f85c3727800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788652226.666959:0:25086:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f85c3727800 3 00010000:00080000:3.0:1788652226.666990:0:25086:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c194b800@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.145@tcp at head 00010000:00010000:3.0:1788652226.669444:0:25086:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788652226.669648:0:25086:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788652226.669723:0:25086:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788652226.669737:0:25086:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcd2f56ea038c5974 00000100:00080000:3.0:1788652226.669748:0:25086:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788652226.669754:0:25086:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f85c194b800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652226.669793:0:25086:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86eeb50e00 x1875537147722368/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788652226.669830:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875537147722368:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788652226.669902:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788652226.669989:0:25086:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788652226.670576:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147722368 00000100:00100000:2.0:1788652226.670585:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147722368 00000100:00100000:2.0:1788652226.670632:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652226.670642:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875537147722368:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788652226.670671:0:22751:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 682 last 0 00000020:00000080:2.0:1788652226.670703:0:22751:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcd2f56ea038c597b 00000004:00100000:2.0:1788652226.670958:0:22751:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788652226.670978:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652226.670985:0:24298:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652226.670989:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652226.670992:0:24298:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788652226.671010:0:22751:0:(import.c:65:import_set_state_nolock()) ffff8f86c3252000 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788652226.671142:0:25086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:2.0:1788652226.671530:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875537147722368:12345-0@lo:38:llog_process_th.0 Request processed in 887us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652226.671539:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788652226.671886:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeb50e00 x1875537147722368/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652236 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652226.671897:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788652226.671925:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788652226.671934:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788652226.671939:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788652226.671943:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c194b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788652226.671951:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875537147722368:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1788652226.671972:0:25073:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788652226.672010:0:25073:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788652226.672038:0:25073:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd400/0xcd2f56ea038c594a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5951 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.672124:0:25073:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd400/0xcd2f56ea038c594a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5951 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788652226.672177:0:25073:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788652226.672180:0:25073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788652226.672182:0:25073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652226.672183:0:25073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652226.672185:0:25073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652226.672186:0:25073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652226.672188:0:25073:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652226.672189:0:25073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652226.672191:0:25073:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788652226.672195:0:25073:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788652226.672198:0:25073:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788652226.672199:0:25073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788652226.672201:0:25073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652226.672202:0:25073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652226.672203:0:25073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652226.672205:0:25073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652226.672206:0:25073:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652226.672207:0:25073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652226.672208:0:25073:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788652226.672228:0:25073:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788652226.672245:0:25073:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147722496:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788652226.672291:0:25073:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.672335:0:25073:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652226.672780:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147722496 00000100:00100000:1.0:1788652226.672788:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147722496 00000100:00100000:1.0:1788652226.672839:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788652226.672848:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147722496:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788652226.672876:0:22744:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788652226.672890:0:22744:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788652226.686663:0:22744:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788652226.686679:0:22744:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788652226.687011:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+24:25073:x1875537147722496:12345-0@lo:253:mount.lustre.0 Request processed in 14159us (14714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652226.687033:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788652226.687150:0:25073:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f967659c-eb6d-423b-8189-3d2637ee2451:25073:1875537147722496:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788652226.687165:0:25073:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788652226.687169:0:25073:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788652226.687171:0:25073:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788652226.687172:0:25073:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652226.687173:0:25073:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652226.687175:0:25073:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652226.687176:0:25073:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652226.687178:0:25073:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788652226.687180:0:25073:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652226.687183:0:25073:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788652226.687200:0:25073:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788652226.688074:0:22766:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788652226.688080:0:22766:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788652226.688102:0:22766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.688119:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c58ef expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.688127:0:22766:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c5904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c58fd expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.688135:0:22766:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.688173:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c5904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c58fd expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.688673:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c5904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c58fd expref: 23 pid: 22745 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652226.688690:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147722624:0@lo:104: 00000100:00100000:2.0:1788652226.688759:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788652226.688814:0:22766:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c58ef expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.688823:0:22766:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c58ef expref: 23 pid: 22744 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652226.688831:0:22766:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147722752:0@lo:104: 00000100:00100000:2.0:1788652226.688851:0:22766:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652226.689014:0:22766:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652226.691983:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147722624 00000100:00100000:0.0:1788652226.692001:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147722624 00000100:00100000:0.0:1788652226.692053:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147722752 00000100:00100000:0.0:1788652226.692057:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147722752 00000100:00100000:0.0:1788652226.692074:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788652226.692085:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+4:22766:x1875537147722624:12345-0@lo:104: 00010000:00010000:0.0:1788652226.692106:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c5904 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652226.692218:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788652226.692231:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+4:22766:x1875537147722624:12345-0@lo:104: Request processed in 143us (3467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652226.692239:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788652226.692280:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788652226.692288:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+3:22766:x1875537147722752:12345-0@lo:104: 00010000:00010000:0.0:1788652226.692296:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c58f6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652226.692331:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788652226.692336:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+3:22766:x1875537147722752:12345-0@lo:104: Request processed in 51us (3484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652226.692343:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1788652226.693368:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652226.693379:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c5904 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.693388:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652226.693393:0:22739:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c5904 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.693403:0:22739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c5904 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652226.693412:0:22739:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c5904 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652226.693417:0:22739:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788652226.693465:0:22739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5904 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.693471:0:22739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652226.693492:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5904 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.693500:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5600/0xcd2f56ea038c58fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5904 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.693515:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652226.693530:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c58f6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.693537:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652226.693540:0:22739:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c58f6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.693547:0:22739:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c58f6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652226.693553:0:22739:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c58f6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652226.693558:0:22739:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788652226.693573:0:22739:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c58f6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.693579:0:22739:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652226.693585:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c58f6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.693591:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c58ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c58f6 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652226.693605:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652226.693606:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652226.693608:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652226.693615:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652226.694723:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147722624:0@lo:104: 00000100:00100000:2.0:1788652226.694737:0:22766:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22766:1875537147722752:0@lo:104: 00010000:00010000:2.0:1788652226.694763:0:22766:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652226.694792:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147722880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652226.694850:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652226.694899:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147722880 00000100:00100000:2.0:1788652226.694904:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788652226.694922:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147722880 00000100:00100000:2.0:1788652226.694925:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147723008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652226.694944:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652226.694954:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c5904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c58fd expref: 24 pid: 22745 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652226.694979:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147723008 00000100:00100000:0.0:1788652226.694982:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147723008 00000100:00100000:2.0:1788652226.694983:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652226.694993:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f967659c-eb6d-423b-8189-3d2637ee2451+25:3635:x1875537147722880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652226.694993:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c58ef expref: 25 pid: 22744 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695006:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788652226.695008:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788652226.695012:0:22737:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c5904 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c58fd expref: 25 pid: 22745 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652226.695013:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+25:3635:x1875537147723008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652226.695019:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652226.695022:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c58ef expref: 25 pid: 22744 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652226.695032:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c58ef expref: 25 pid: 22744 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652226.695049:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c0031c00/0xcd2f56ea038c58f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c58ef expref: 25 pid: 22744 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652226.695074:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652226.695111:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+24:3635:x1875537147723008:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (165us total) trans 0 rc 0/0 00010000:00010000:2.0:1788652226.695158:0:22737:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c5904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c58fd expref: 24 pid: 22745 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695167:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c5904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c58fd expref: 24 pid: 22745 timeout: 782 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695179:0:22737:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695187:0:22737:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788652226.695212:0:22737:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007132275s 00010000:00010000:2.0:1788652226.695217:0:22737:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695224:0:22737:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695230:0:22737:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695236:0:22737:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695242:0:22737:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652226.695246:0:22737:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695254:0:22737:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695267:0:22737:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695276:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652226.695300:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f967659c-eb6d-423b-8189-3d2637ee2451+23:3635:x1875537147722880:12345-0@lo:103:ldlm_bl.0 Request processed in 309us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652226.695307:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652226.695349:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147723008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652226.695357:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147722880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652226.695382:0:22766:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695389:0:22766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652226.695395:0:22766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5982 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652226.695656:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000001:00000004:1.0:1788652226.696405:0:25073:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:1.0:1788652226.698778:0:25073:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788652226.698903:0:25073:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788652226.699113:0:25073:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788652226.699159:0:25073:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.145@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788652226.699179:0:25073:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788652226.699200:0:25073:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788652226.700248:0:25073:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788652226.700491:0:25073:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788652226.979405:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788652227.496062:0:25140:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788652227.496361:0:25140:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788652227.680679:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652207/real 1788652207] req@ffff8f85c348ed80 x1875537147709312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652227 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.680719:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f85c348ed80 x1875537147709312/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652227 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.680730:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652207/real 1788652207] req@ffff8f85c348d180 x1875537147709440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652227 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.680755:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f85c348d180 x1875537147709440/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652227 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788652227.680774:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c373d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788652227.680797:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788652227.680805:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147709312:0@lo:8:kworker.0 00000100:00080000:3.0:1788652227.680811:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbf000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788652227.680816:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788652227.680819:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147709440:0@lo:8:kworker.0 00000100:00080000:3.0:1788652227.680967:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652227.680971:0:24298:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788652227.680973:0:24298:0:(import.c:65:import_set_state_nolock()) ffff8f85c373d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652227.680979:0:24298:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 663 00000100:00080000:3.0:1788652227.680984:0:24298:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788652227.680991:0:24298:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f85c373d800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652227.681010:0:24298:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86eeb50a80 x1875537147723392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652227.681023:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652227.681026:0:24298:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788652227.681028:0:24298:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbf000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652227.681030:0:24298:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 663 00000100:00080000:3.0:1788652227.681033:0:24298:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788652227.681036:0:24298:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f85c3fbf000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652227.681046:0:24298:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86eeb52a00 x1875537147723520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652227.681159:0:24298:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652227.681162:0:24298:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788652227.681164:0:24298:0:(import.c:65:import_set_state_nolock()) ffff8f85c3dc4800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652227.681169:0:24298:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f85c3dc4800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652227.681178:0:24298:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86eeb50380 x1875537147724032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788652227.681221:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f967659c-eb6d-423b-8189-3d2637ee2451:3637:1875537147723136:0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.681289:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.681596:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147723904:0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.681623:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.681643:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147724544:0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.681664:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.681682:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788652227.681697:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147723264:0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.681721:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.681738:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147724160:0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.681755:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.681771:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147724672:0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.681787:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.681817:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147723648:0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.681838:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.681856:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147724288:0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.681873:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.681892:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788652227.681897:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147723776:0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.681937:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.681954:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147724416:0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.681973:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.682000:0:24745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147723904 00000100:00100000:3.0:1788652227.682010:0:24745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147723904 00000100:00100000:3.0:1788652227.682065:0:24745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652227.682075:0:24745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147723904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.682125:0:24745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147723904:12345-0@lo:400:kworker.0 Request processed in 50us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652227.682132:0:24745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652227.682156:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147724544 00000100:00100000:3.0:1788652227.682161:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147724544 00000100:00100000:3.0:1788652227.682183:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147724160 00000100:00100000:3.0:1788652227.682185:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147724160 00000100:00100000:3.0:1788652227.682194:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147724672 00000100:00100000:3.0:1788652227.682196:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147724672 00000100:00100000:3.0:1788652227.682208:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147723648 00000100:00100000:3.0:1788652227.682210:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147723648 00000100:00100000:3.0:1788652227.682219:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147724288 00000100:00100000:3.0:1788652227.682221:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147724288 00000100:00100000:3.0:1788652227.682232:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147724416 00000100:00100000:3.0:1788652227.682234:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147724416 00000100:00100000:3.0:1788652227.682245:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788652227.682252:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147724544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.682283:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147724544:12345-0@lo:400:kworker.0 Request processed in 32us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652227.682288:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788652227.682307:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788652227.682312:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147724160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.682338:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147724160:12345-0@lo:400:kworker.0 Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652227.682343:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788652227.682354:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788652227.682359:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147724672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.682383:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147724672:12345-0@lo:400:kworker.0 Request processed in 24us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652227.682388:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788652227.682400:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788652227.682405:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147723648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.682435:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147723648:12345-0@lo:400:kworker.0 Request processed in 30us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652227.682441:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788652227.682452:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788652227.682458:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147724288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.682482:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147724288:12345-0@lo:400:kworker.0 Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652227.682488:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652227.683527:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147723136 00000100:00100000:2.0:1788652227.683537:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147723136 00000100:00100000:2.0:1788652227.683624:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788652227.683632:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+22:3637:x1875537147723136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652227.683698:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+22:3637:x1875537147723136:12345-0@lo:400:kworker.0 Request processed in 57us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652227.683757:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788652227.683989:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788652227.684002:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147724416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652227.684044:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147724416:12345-0@lo:400:kworker.0 Request processed in 47us (2069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652227.684051:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788652227.684078:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147723264 00000100:00100000:0.0:1788652227.684083:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147723264 00000100:00100000:0.0:1788652227.684402:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147723776 00000100:00100000:0.0:1788652227.684407:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147723776 00000100:00100000:0.0:1788652227.684423:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788652227.684428:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147723264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652227.684460:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147723264:12345-0@lo:400:kworker.0 Request processed in 32us (2740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652227.684466:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788652227.684476:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788652227.684482:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147723776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652227.684517:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147723776:12345-0@lo:400:kworker.0 Request processed in 35us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652227.684523:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788652227.684625:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788652227.684630:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788652227.684634:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652227.684678:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147723392:0@lo:8:kworker.0 00000100:00100000:0.0:1788652227.684732:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652227.684766:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147723520:0@lo:8:kworker.0 00000100:00100000:0.0:1788652227.684805:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652227.684826:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147724032:0@lo:8:kworker.0 00000100:00100000:0.0:1788652227.684846:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652227.684876:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147723392 00000100:00100000:0.0:1788652227.684880:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147723392 00000100:00100000:0.0:1788652227.684890:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147723520 00000100:00100000:0.0:1788652227.684893:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147723520 00000100:00100000:0.0:1788652227.684898:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147724032 00000100:00100000:0.0:1788652227.684900:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147724032 00000100:00100000:0.0:1788652227.684925:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788652227.684930:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875537147723392:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788652227.684956:0:24259:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:0.0:1788652227.684988:0:24259:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c5989 00002000:00100000:0.0:1788652227.685002:0:24259:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f85c3554800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788652227.685007:0:24259:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788652227.685009:0:24259:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788652227.685081:0:24259:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788652227.685105:0:24259:0:(import.c:65:import_set_state_nolock()) ffff8f85c3554000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652227.685143:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1875537147723392:12345-0@lo:8:kworker.0 Request processed in 212us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652227.685150:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788652227.685162:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788652227.685166:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875537147723520:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788652227.685180:0:24259:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:0.0:1788652227.685194:0:24259:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c5990 00002000:00100000:0.0:1788652227.685205:0:24259:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f85c3555800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788652227.685208:0:24259:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788652227.685210:0:24259:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788652227.686375:0:24256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788652227.686384:0:24256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875537147724032:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788652227.686407:0:24256:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 683 last 0 00000020:00000080:3.0:1788652227.686434:0:24256:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c5997 00002000:00100000:3.0:1788652227.686444:0:24256:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f85c1948000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788652227.686448:0:24256:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788652227.686450:0:24256:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788652227.686489:0:24256:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788652227.686521:0:24256:0:(import.c:65:import_set_state_nolock()) ffff8f85c1949800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652227.686668:0:24256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875537147724032:12345-0@lo:8:kworker.0 Request processed in 264us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652227.686676:0:24256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788652227.686820:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147723776:0@lo:400:kworker.0 00010000:00080000:3.0:1788652227.686839:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d4a80 x1875537147724416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.686850:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147724416:0@lo:400:kworker.0 00010000:00080000:3.0:1788652227.686864:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb51f80 x1875537147723648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.686873:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147723648:0@lo:400:kworker.0 00010000:00080000:3.0:1788652227.686889:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d6a00 x1875537147724288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.686898:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147724288:0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.686963:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147723264:0@lo:400:kworker.0 00010000:00080000:3.0:1788652227.686976:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d6300 x1875537147724160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.686983:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147724160:0@lo:400:kworker.0 00010000:00080000:3.0:1788652227.687005:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d7100 x1875537147724672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.687013:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147724672:0@lo:400:kworker.0 00000100:00100000:3.0:1788652227.687024:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f967659c-eb6d-423b-8189-3d2637ee2451:3637:1875537147723136:0@lo:400:kworker.0 00010000:00080000:3.0:1788652227.687034:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb53b80 x1875537147723904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.687041:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147723904:0@lo:400:kworker.0 00010000:00080000:3.0:1788652227.687051:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d6680 x1875537147724544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.687060:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147724544:0@lo:400:kworker.0 00002000:00080000:0.0:1788652227.687703:0:24259:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788652227.687728:0:24259:0:(import.c:65:import_set_state_nolock()) ffff8f85c3550800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652227.687778:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1875537147723520:12345-0@lo:8:kworker.0 Request processed in 2609us (2971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652227.687786:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788652227.687828:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb50a80 x1875537147723392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788652252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652227.687837:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788652227.687843:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788652227.687852:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788652227.687857:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788652227.687860:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c373d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788652227.687880:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788652227.687885:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147723392:0@lo:8:kworker.0 00010000:00080000:0.0:1788652227.687898:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb52a00 x1875537147723520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788652252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652227.687920:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788652227.687925:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788652227.687929:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788652227.687932:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788652227.687934:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbf000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788652227.687949:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788652227.687952:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147723520:0@lo:8:kworker.0 00010000:00080000:0.0:1788652227.687974:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb50380 x1875537147724032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788652252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788652227.687984:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000004:00080000:2.0:1788652227.687987:0:22777:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00080000:0.0:1788652227.687988:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788652227.687991:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788652227.687992:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3dc4800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788652227.688002:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788652227.688005:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147724032:0@lo:8:kworker.0 00000004:00080000:0.0:1788652227.688034:0:22774:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788652227.688080:0:22777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22777:1875537147724928:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788652227.688107:0:22774:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 683623198464ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788652227.688113:0:22774:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788652227.688116:0:22777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788652227.688132:0:22776:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788652227.688137:0:22777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0e88000 going to sleep for 11 seconds 00000004:00080000:0.0:1788652227.688161:0:22776:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 683623253047ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788652227.688165:0:22776:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788652227.688174:0:23495:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788652227.688207:0:23495:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 683623299065ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788652227.688211:0:23495:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1788652227.689134:0:22775:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788652227.689151:0:22775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22775:1875537147725184:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788652227.689196:0:22775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.689225:0:22775:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3f390c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788652227.689334:0:23496:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788652227.689352:0:23496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23496:1875537147725440:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788652227.689377:0:23496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.689392:0:23496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3f39a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652227.689408:0:24256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147724928 00000100:00100000:3.0:1788652227.689415:0:24256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147724928 00000100:00100000:3.0:1788652227.689455:0:24256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147725184 00000100:00100000:3.0:1788652227.689458:0:24256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147725184 00000100:00100000:3.0:1788652227.689471:0:24256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147725440 00000100:00100000:3.0:1788652227.689473:0:24256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147725440 00000100:00100000:3.0:1788652227.690290:0:24256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788652227.690302:0:24256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22777:x1875537147724928:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1788652227.690868:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652227.690874:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652227.690965:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147725056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652227.691016:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.691049:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652227.691056:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147724800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652227.691082:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.691112:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147725056 00000100:00100000:3.0:1788652227.691119:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147725056 00000100:00100000:3.0:1788652227.691145:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147724800 00000100:00100000:3.0:1788652227.691147:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147724800 00000100:00100000:3.0:1788652227.691158:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652227.691164:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147725056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652227.691185:0:24260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788652227.691227:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147725056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652227.691234:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652227.691250:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652227.691256:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147724800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788652227.691266:0:24260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923517440 avail 3691995136 00000100:00100000:3.0:1788652227.691291:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147724800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652227.691297:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652227.691315:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652227.691324:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147725312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788652227.691355:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.692075:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652227.692100:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22775:x1875537147725184:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:3.0:1788652227.692242:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36f7b80 x1875537147724800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.692271:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147724800:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788652227.692281:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d6680 x1875537147725056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.692290:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147725056:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652227.692320:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147725312 00000100:00100000:3.0:1788652227.692324:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147725312 00000100:00100000:3.0:1788652227.692356:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652227.692362:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1875537147725312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788652227.692372:0:24260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923517440 avail 3691995136 00000100:00100000:3.0:1788652227.692409:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1875537147725312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652227.692414:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788652227.692434:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d6a00 x1875537147725312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652243 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652227.692446:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147725312:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788652227.694380:0:23484:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788652227.695358:0:24256:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788652227.695368:0:24256:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:0.0:1788652227.695374:0:24256:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00080000:3.0:1788652227.695600:0:24258:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788652227.695605:0:24258:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:3.0:1788652227.695608:0:24258:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00000100:00100000:1.0:1788652227.695863:0:24745:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788652227.695873:0:24745:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788652227.704734:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788652227.704754:0:25157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23496:x1875537147725440:12345-0@lo:7:osp-pre-1-1.0 00002000:00080000:1.0:1788652227.707961:0:25157:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788652227.707976:0:25157:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788652227.708102:0:25157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23496:x1875537147725440:12345-0@lo:7:osp-pre-1-1.0 Request processed in 3347us (18715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652227.708113:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788652227.708515:0:23496:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d4a80 x1875537147725440/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788652243 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652227.708534:0:23496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23496:1875537147725440:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788652227.708552:0:23496:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788652227.708599:0:23496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23496:1875537147725568:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788652227.708652:0:23496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652227.708682:0:23496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952240 going to sleep for 11 seconds 00002000:00010000:0.0:1788652227.708800:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.708810:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000907da683/0xcd2f56ea038c599e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.708828:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.708833:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.708840:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000907da683/0xcd2f56ea038c599e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.708858:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000907da683/0xcd2f56ea038c599e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.708869:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000907da683/0xcd2f56ea038c599e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.708878:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000907da683/0xcd2f56ea038c599e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.708897:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652227.708928:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.708934:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000907da683/0xcd2f56ea038c599e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.708941:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.708946:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000907da683/0xcd2f56ea038c599e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.708962:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000907da683/0xcd2f56ea038c599e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.708978:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000907da683/0xcd2f56ea038c599e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.708986:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000907da683/0xcd2f56ea038c599e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.709121:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.709123:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.709125:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652227.710103:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.710111:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec953f4d/0xcd2f56ea038c59a5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.710122:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.710125:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.710131:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec953f4d/0xcd2f56ea038c59a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.710142:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec953f4d/0xcd2f56ea038c59a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.710150:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec953f4d/0xcd2f56ea038c59a5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.710165:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec953f4d/0xcd2f56ea038c59a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.710190:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788652227.710364:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652227.710372:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec953f4d/0xcd2f56ea038c59a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.710380:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.710385:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec953f4d/0xcd2f56ea038c59a5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.710394:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec953f4d/0xcd2f56ea038c59a5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.710410:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec953f4d/0xcd2f56ea038c59a5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.710429:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec953f4d/0xcd2f56ea038c59a5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.710449:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.710451:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.710453:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652227.710815:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.710822:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aef1eb6/0xcd2f56ea038c59ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.710832:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.710835:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.710839:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aef1eb6/0xcd2f56ea038c59ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.710848:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aef1eb6/0xcd2f56ea038c59ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.710856:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003aef1eb6/0xcd2f56ea038c59ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.710864:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003aef1eb6/0xcd2f56ea038c59ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.710956:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788652227.711300:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.711306:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000532d6dc8/0xcd2f56ea038c59b3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.711321:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.711324:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.711328:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000532d6dc8/0xcd2f56ea038c59b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.711338:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000532d6dc8/0xcd2f56ea038c59b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.711346:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000532d6dc8/0xcd2f56ea038c59b3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.711354:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000532d6dc8/0xcd2f56ea038c59b3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.713389:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652227.713401:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003aef1eb6/0xcd2f56ea038c59ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.713413:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.713418:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003aef1eb6/0xcd2f56ea038c59ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.713430:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003aef1eb6/0xcd2f56ea038c59ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.713452:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003aef1eb6/0xcd2f56ea038c59ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.713460:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aef1eb6/0xcd2f56ea038c59ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.713485:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652227.713499:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000532d6dc8/0xcd2f56ea038c59b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.713516:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.713519:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000532d6dc8/0xcd2f56ea038c59b3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.713526:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000532d6dc8/0xcd2f56ea038c59b3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.713535:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000532d6dc8/0xcd2f56ea038c59b3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.713542:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.713544:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.713545:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.715057:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788652227.715069:0:24256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000532d6dc8/0xcd2f56ea038c59b3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788652227.717530:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.717545:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe1d941c/0xcd2f56ea038c59ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.717564:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.717569:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.717575:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe1d941c/0xcd2f56ea038c59ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.717609:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe1d941c/0xcd2f56ea038c59ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.717620:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe1d941c/0xcd2f56ea038c59ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.717628:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe1d941c/0xcd2f56ea038c59ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652227.718351:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147725568 00000100:00100000:3.0:1788652227.718371:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147725568 00000100:00100000:3.0:1788652227.718429:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788652227.718439:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23496:x1875537147725568:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788652227.718474:0:24259:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788652227.718574:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23496:x1875537147725568:12345-0@lo:5:osp-pre-1-1.0 Request processed in 136us (9921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652227.718582:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1788652227.719183:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652227.719193:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe1d941c/0xcd2f56ea038c59ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.719203:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.719209:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe1d941c/0xcd2f56ea038c59ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.719219:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe1d941c/0xcd2f56ea038c59ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.719242:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe1d941c/0xcd2f56ea038c59ba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788652227.719715:0:22730:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788652227.719733:0:22730:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788652227.719844:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.719851:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006276d9e3/0xcd2f56ea038c59c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.719864:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.719868:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.719874:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006276d9e3/0xcd2f56ea038c59c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.719889:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006276d9e3/0xcd2f56ea038c59c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.719898:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006276d9e3/0xcd2f56ea038c59c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.719942:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006276d9e3/0xcd2f56ea038c59c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.720224:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.720226:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.720228:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.720368:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788652227.720578:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652227.720585:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006276d9e3/0xcd2f56ea038c59c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.720593:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.720597:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006276d9e3/0xcd2f56ea038c59c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.720607:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006276d9e3/0xcd2f56ea038c59c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.720625:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006276d9e3/0xcd2f56ea038c59c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.720634:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006276d9e3/0xcd2f56ea038c59c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.720651:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.720653:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.720654:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652227.721068:0:23496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23496:1875537147725568:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788652227.721083:0:23496:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00002000:00010000:3.0:1788652227.721213:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.721219:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000610d8455/0xcd2f56ea038c59c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.721229:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.721233:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.721238:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000610d8455/0xcd2f56ea038c59c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.721247:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000610d8455/0xcd2f56ea038c59c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652227.721332:0:23496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23496:1875537147725696:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788652227.721392:0:23496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652227.721419:0:23496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef240 going to sleep for 11 seconds 00000100:00100000:1.0:1788652227.721439:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147725696 00000100:00100000:1.0:1788652227.721446:0:25157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147725696 00000100:00100000:1.0:1788652227.721492:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788652227.721571:0:25157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23496:x1875537147725696:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788652227.721617:0:25157:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00010000:00010000:3.0:1788652227.721888:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000610d8455/0xcd2f56ea038c59c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.721896:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000610d8455/0xcd2f56ea038c59c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.721939:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.721949:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.721954:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000610d8455/0xcd2f56ea038c59c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.721961:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.721966:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000610d8455/0xcd2f56ea038c59c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.721986:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000610d8455/0xcd2f56ea038c59c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.722095:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788652227.722102:0:24256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe1d941c/0xcd2f56ea038c59ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.722134:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.722641:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000610d8455/0xcd2f56ea038c59c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.722651:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000610d8455/0xcd2f56ea038c59c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.722667:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.722669:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.722670:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652227.723123:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.723130:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000395c7db/0xcd2f56ea038c59cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.723141:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.723145:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.723151:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000395c7db/0xcd2f56ea038c59cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.723162:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000395c7db/0xcd2f56ea038c59cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.723183:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000395c7db/0xcd2f56ea038c59cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.723190:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000395c7db/0xcd2f56ea038c59cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.723210:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788652227.723438:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.723444:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3c3f20/0xcd2f56ea038c59d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.723452:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.723455:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.723460:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e3c3f20/0xcd2f56ea038c59d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.723469:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e3c3f20/0xcd2f56ea038c59d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.723477:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e3c3f20/0xcd2f56ea038c59d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.723489:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e3c3f20/0xcd2f56ea038c59d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.723717:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652227.723724:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000395c7db/0xcd2f56ea038c59cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.723733:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0030400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.723737:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000395c7db/0xcd2f56ea038c59cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.723747:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000395c7db/0xcd2f56ea038c59cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.723764:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000395c7db/0xcd2f56ea038c59cf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.723771:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000395c7db/0xcd2f56ea038c59cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.723787:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.723793:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.723795:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.724063:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.724071:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.724075:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e3c3f20/0xcd2f56ea038c59d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.724083:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.724086:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3c3f20/0xcd2f56ea038c59d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.724095:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e3c3f20/0xcd2f56ea038c59d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.724106:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e3c3f20/0xcd2f56ea038c59d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.724113:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e3c3f20/0xcd2f56ea038c59d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.724127:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.724128:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.724130:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788652227.724295:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788652227.724301:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040b58fa5/0xcd2f56ea038c59dd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.724310:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788652227.724313:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652227.724318:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040b58fa5/0xcd2f56ea038c59dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.724328:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040b58fa5/0xcd2f56ea038c59dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.724336:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040b58fa5/0xcd2f56ea038c59dd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.724344:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040b58fa5/0xcd2f56ea038c59dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.724361:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.724992:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.725014:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040b58fa5/0xcd2f56ea038c59dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.725023:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.725027:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040b58fa5/0xcd2f56ea038c59dd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.725037:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040b58fa5/0xcd2f56ea038c59dd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.725053:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040b58fa5/0xcd2f56ea038c59dd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.725061:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040b58fa5/0xcd2f56ea038c59dd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.725078:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.725080:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.725081:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652227.725173:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.725180:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8721e0c/0xcd2f56ea038c59e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.725189:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.725192:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.725197:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8721e0c/0xcd2f56ea038c59e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.725208:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8721e0c/0xcd2f56ea038c59e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.725216:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8721e0c/0xcd2f56ea038c59e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.725224:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8721e0c/0xcd2f56ea038c59e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.725251:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.725594:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.725600:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8721e0c/0xcd2f56ea038c59e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.725608:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0031c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.725611:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8721e0c/0xcd2f56ea038c59e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.725630:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8721e0c/0xcd2f56ea038c59e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.725642:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8721e0c/0xcd2f56ea038c59e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.725649:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8721e0c/0xcd2f56ea038c59e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.725664:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.725666:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.725668:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652227.725994:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.726010:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011977d76/0xcd2f56ea038c59eb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.726019:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.726023:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.726027:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011977d76/0xcd2f56ea038c59eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.726037:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011977d76/0xcd2f56ea038c59eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.726046:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000011977d76/0xcd2f56ea038c59eb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.726054:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000011977d76/0xcd2f56ea038c59eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.726071:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652227.726079:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.726082:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000011977d76/0xcd2f56ea038c59eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.726088:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.726097:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000011977d76/0xcd2f56ea038c59eb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.726106:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000011977d76/0xcd2f56ea038c59eb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.726116:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000011977d76/0xcd2f56ea038c59eb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.726124:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011977d76/0xcd2f56ea038c59eb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.726138:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.726140:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.726141:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.726872:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.726880:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d362f5e/0xcd2f56ea038c59f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.726890:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.726894:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.726899:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d362f5e/0xcd2f56ea038c59f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.726927:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d362f5e/0xcd2f56ea038c59f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.726937:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d362f5e/0xcd2f56ea038c59f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.726955:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d362f5e/0xcd2f56ea038c59f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.726973:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652227.727452:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.727460:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d362f5e/0xcd2f56ea038c59f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.727468:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.727473:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d362f5e/0xcd2f56ea038c59f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.727482:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d362f5e/0xcd2f56ea038c59f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788652227.727631:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.727637:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c59f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.727645:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.727648:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.727652:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c59f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.727660:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c59f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.727667:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c59f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.727674:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c59f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.727700:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652227.727929:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d362f5e/0xcd2f56ea038c59f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.727944:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d362f5e/0xcd2f56ea038c59f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.727962:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.727965:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c59f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.727971:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.727974:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c59f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.727981:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c59f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.727992:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c59f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.728010:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c59f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.728023:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.728026:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.728028:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.728034:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788652227.728171:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788652227.728179:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a82c873/0xcd2f56ea038c5a00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.728187:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788652227.728189:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652227.728193:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a82c873/0xcd2f56ea038c5a00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.728209:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a82c873/0xcd2f56ea038c5a00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.728218:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a82c873/0xcd2f56ea038c5a00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.728225:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a82c873/0xcd2f56ea038c5a00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.728240:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.728605:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.728610:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a82c873/0xcd2f56ea038c5a00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.728624:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.728627:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a82c873/0xcd2f56ea038c5a00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.728635:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a82c873/0xcd2f56ea038c5a00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.728647:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a82c873/0xcd2f56ea038c5a00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.728653:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a82c873/0xcd2f56ea038c5a00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.728668:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.728669:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.728670:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788652227.728875:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788652227.728881:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5a07 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.728888:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788652227.728891:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652227.728895:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5a07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.728926:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5a07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.728935:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5a07 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.728953:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5a07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.728968:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788652227.729168:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.729180:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4349f8f/0xcd2f56ea038c5a0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.729188:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.729191:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.729195:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4349f8f/0xcd2f56ea038c5a0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.729204:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4349f8f/0xcd2f56ea038c5a0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.729211:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a4349f8f/0xcd2f56ea038c5a0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.729218:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4349f8f/0xcd2f56ea038c5a0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.729233:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788652227.729289:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788652227.729294:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5a07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.729302:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.729305:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5a07 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.729314:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5a07 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.729408:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5a07 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.729415:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5a07 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.729429:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.729432:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4349f8f/0xcd2f56ea038c5a0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.729437:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.729440:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4349f8f/0xcd2f56ea038c5a0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.729446:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4349f8f/0xcd2f56ea038c5a0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.729453:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4349f8f/0xcd2f56ea038c5a0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.729459:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4349f8f/0xcd2f56ea038c5a0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.729470:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.729472:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.729481:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.730618:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652227.731024:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.731032:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443f3c4b/0xcd2f56ea038c5a15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.731046:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.731051:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.731056:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000443f3c4b/0xcd2f56ea038c5a15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.731070:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000443f3c4b/0xcd2f56ea038c5a15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.731087:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000443f3c4b/0xcd2f56ea038c5a15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.731096:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000443f3c4b/0xcd2f56ea038c5a15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.731110:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.731259:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.731266:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000443f3c4b/0xcd2f56ea038c5a15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.731274:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.731279:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000443f3c4b/0xcd2f56ea038c5a15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.731288:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000443f3c4b/0xcd2f56ea038c5a15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.731303:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000443f3c4b/0xcd2f56ea038c5a15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.731312:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000443f3c4b/0xcd2f56ea038c5a15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.731328:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.731330:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.731332:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.731766:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.731773:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f0396ec/0xcd2f56ea038c5a1c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.731783:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.731787:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.731792:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f0396ec/0xcd2f56ea038c5a1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.731808:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f0396ec/0xcd2f56ea038c5a1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.731816:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f0396ec/0xcd2f56ea038c5a1c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.731823:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f0396ec/0xcd2f56ea038c5a1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.731845:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652227.732013:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.732019:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f0396ec/0xcd2f56ea038c5a1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.732026:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.732029:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f0396ec/0xcd2f56ea038c5a1c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.732038:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f0396ec/0xcd2f56ea038c5a1c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.732051:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f0396ec/0xcd2f56ea038c5a1c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.732059:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f0396ec/0xcd2f56ea038c5a1c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.732074:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.732082:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.732084:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.732444:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.732450:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5a23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.732459:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.732462:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.732466:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.732474:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.732482:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5a23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.732512:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5a23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.732532:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652227.732710:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.732715:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5a23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.732722:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.732726:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5a23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.732734:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5a23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.732745:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5a23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.732752:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5a23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.732767:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.732769:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.732770:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652227.734152:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.734163:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061123cbf/0xcd2f56ea038c5a2a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.734177:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.734181:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.734192:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061123cbf/0xcd2f56ea038c5a2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.734206:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061123cbf/0xcd2f56ea038c5a2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.734216:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061123cbf/0xcd2f56ea038c5a2a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.734224:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061123cbf/0xcd2f56ea038c5a2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.734246:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.734595:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.734603:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061123cbf/0xcd2f56ea038c5a2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.734611:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.734616:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061123cbf/0xcd2f56ea038c5a2a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.734625:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061123cbf/0xcd2f56ea038c5a2a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.734642:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061123cbf/0xcd2f56ea038c5a2a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.734649:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061123cbf/0xcd2f56ea038c5a2a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.734666:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.734668:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.734669:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.734875:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.734888:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e557917/0xcd2f56ea038c5a31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.734897:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.734901:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.734957:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e557917/0xcd2f56ea038c5a31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.734969:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e557917/0xcd2f56ea038c5a31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.734977:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e557917/0xcd2f56ea038c5a31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.734985:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e557917/0xcd2f56ea038c5a31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.735050:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652227.735199:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.735205:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e557917/0xcd2f56ea038c5a31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.735213:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.735217:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e557917/0xcd2f56ea038c5a31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.735226:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e557917/0xcd2f56ea038c5a31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.735238:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e557917/0xcd2f56ea038c5a31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.735256:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e557917/0xcd2f56ea038c5a31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.735269:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.735270:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.735272:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.735898:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.735928:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c5a38 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.735940:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.735943:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.735948:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c5a38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.735958:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c5a38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.735974:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c5a38 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.735982:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c5a38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.735996:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652227.736153:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.736159:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c5a38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.736167:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.736170:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c5a38 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.736179:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c5a38 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.736191:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c5a38 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.736199:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c5a38 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.736212:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.736214:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.736215:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788652227.736899:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788652227.736920:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029424c4e/0xcd2f56ea038c5a3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.736931:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788652227.736935:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652227.736940:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029424c4e/0xcd2f56ea038c5a3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.736951:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029424c4e/0xcd2f56ea038c5a3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.736959:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029424c4e/0xcd2f56ea038c5a3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.736967:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029424c4e/0xcd2f56ea038c5a3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.736982:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.737124:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.737130:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029424c4e/0xcd2f56ea038c5a3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.737138:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.737142:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029424c4e/0xcd2f56ea038c5a3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.737151:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029424c4e/0xcd2f56ea038c5a3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.737164:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029424c4e/0xcd2f56ea038c5a3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.737171:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029424c4e/0xcd2f56ea038c5a3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.737186:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.737192:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.737194:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788652227.737628:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788652227.737641:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215eed66/0xcd2f56ea038c5a46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.737650:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788652227.737653:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652227.737658:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215eed66/0xcd2f56ea038c5a46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.737667:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215eed66/0xcd2f56ea038c5a46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.737676:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215eed66/0xcd2f56ea038c5a46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.737683:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000215eed66/0xcd2f56ea038c5a46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.737711:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.738076:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.738081:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000215eed66/0xcd2f56ea038c5a46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.738089:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.738093:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000215eed66/0xcd2f56ea038c5a46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.738101:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000215eed66/0xcd2f56ea038c5a46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.738113:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000215eed66/0xcd2f56ea038c5a46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.738120:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215eed66/0xcd2f56ea038c5a46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.738135:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.738136:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.738138:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652227.739373:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.739384:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5a4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.739397:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.739401:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.739407:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5a4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.739420:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5a4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.739429:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5a4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.739437:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5a4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.739461:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652227.739657:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652227.739664:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5a4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.739671:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652227.739675:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5a4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.739708:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5a4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.739725:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5a4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.739732:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5a4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.739751:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.739753:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.739755:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788652227.739876:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788652227.739882:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5a54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.739890:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788652227.739893:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652227.739898:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5a54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.739928:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5a54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.739943:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5a54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.739952:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5a54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.740007:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788652227.740408:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.740414:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3dca60/0xcd2f56ea038c5a5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.740422:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.740425:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.740428:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c3dca60/0xcd2f56ea038c5a5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.740449:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c3dca60/0xcd2f56ea038c5a5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.740457:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3dca60/0xcd2f56ea038c5a5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.740464:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c3dca60/0xcd2f56ea038c5a5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.740484:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788652227.740586:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652227.740591:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5a54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.740599:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.740603:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5a54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.740612:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5a54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.740627:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5a54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.740634:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5a54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.740650:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652227.740654:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c3dca60/0xcd2f56ea038c5a5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.740666:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.740669:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3dca60/0xcd2f56ea038c5a5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.740677:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3dca60/0xcd2f56ea038c5a5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.740700:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c3dca60/0xcd2f56ea038c5a5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.740708:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c3dca60/0xcd2f56ea038c5a5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.740722:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.740724:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.740725:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.740798:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652227.741125:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.741132:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c5a62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741141:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.741144:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.741148:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c5a62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741157:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c5a62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741164:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c5a62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741183:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c5a62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741372:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788652227.741602:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1788652227.741602:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652227.741609:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d35ae5/0xcd2f56ea038c5a70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741609:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009049f5bc/0xcd2f56ea038c5a69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.741618:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.741619:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=683s v=(0 0) 00010000:00010000:2.0:1788652227.741622:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.741622:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652227.741627:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d35ae5/0xcd2f56ea038c5a70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741627:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009049f5bc/0xcd2f56ea038c5a69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.741638:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3d35ae5/0xcd2f56ea038c5a70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741638:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009049f5bc/0xcd2f56ea038c5a69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741647:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009049f5bc/0xcd2f56ea038c5a69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.741648:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3d35ae5/0xcd2f56ea038c5a70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741654:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009049f5bc/0xcd2f56ea038c5a69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.741660:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3d35ae5/0xcd2f56ea038c5a70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741668:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788652227.741669:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788652227.741676:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788652227.741681:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c5a62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741706:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.741710:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c5a62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741718:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c5a62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741731:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c5a62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741738:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c5a62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741751:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652227.741755:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009049f5bc/0xcd2f56ea038c5a69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741761:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.741764:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009049f5bc/0xcd2f56ea038c5a69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.741771:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009049f5bc/0xcd2f56ea038c5a69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.741820:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.742070:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009049f5bc/0xcd2f56ea038c5a69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652227.742079:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.742083:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009049f5bc/0xcd2f56ea038c5a69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.742084:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3a9db98/0xcd2f56ea038c5a77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.742093:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=683s v=(0 0) 00010000:00010000:2.0:1788652227.742096:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.742098:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.742099:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.742100:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a3a9db98/0xcd2f56ea038c5a77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742101:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.742110:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a3a9db98/0xcd2f56ea038c5a77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.742118:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a3a9db98/0xcd2f56ea038c5a77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.742125:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a3a9db98/0xcd2f56ea038c5a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.742143:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652227.742149:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.742153:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a3a9db98/0xcd2f56ea038c5a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742160:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.742163:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3a9db98/0xcd2f56ea038c5a77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742171:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a3a9db98/0xcd2f56ea038c5a77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742183:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a3a9db98/0xcd2f56ea038c5a77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742190:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3a9db98/0xcd2f56ea038c5a77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742202:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.742204:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.742206:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652227.742555:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.742561:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cebcd589/0xcd2f56ea038c5a7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742569:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.742573:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.742577:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cebcd589/0xcd2f56ea038c5a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742586:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cebcd589/0xcd2f56ea038c5a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742594:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cebcd589/0xcd2f56ea038c5a7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742601:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cebcd589/0xcd2f56ea038c5a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742614:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652227.742620:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.742623:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cebcd589/0xcd2f56ea038c5a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742630:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.742634:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cebcd589/0xcd2f56ea038c5a7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742652:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cebcd589/0xcd2f56ea038c5a7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652227.742662:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.742662:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cebcd589/0xcd2f56ea038c5a7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.742668:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003166c062/0xcd2f56ea038c5a85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742670:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cebcd589/0xcd2f56ea038c5a7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.742681:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.742683:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.742684:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.742696:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.742698:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.742700:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003166c062/0xcd2f56ea038c5a85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.742709:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003166c062/0xcd2f56ea038c5a85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.742718:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003166c062/0xcd2f56ea038c5a85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.742725:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003166c062/0xcd2f56ea038c5a85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.742743:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652227.742748:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.742752:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003166c062/0xcd2f56ea038c5a85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742759:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dce00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.742762:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003166c062/0xcd2f56ea038c5a85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.742770:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003166c062/0xcd2f56ea038c5a85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.742861:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.742863:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.742865:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.743122:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003166c062/0xcd2f56ea038c5a85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743141:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003166c062/0xcd2f56ea038c5a85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743155:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.743157:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.743159:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652227.743425:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.743431:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c5a8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743439:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.743442:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.743446:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c5a8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743455:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c5a8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743463:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c5a8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743470:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c5a8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743486:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788652227.743726:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.743736:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c5a93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743744:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.743747:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.743751:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c5a93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743759:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c5a93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743767:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c5a93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743893:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c5a93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743926:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788652227.743935:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652227.743939:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c5a8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743946:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.743950:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c5a8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743958:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c5a8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743976:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c5a8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743982:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c5a8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.743995:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.744049:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c5a93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744055:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.744058:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c5a93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744064:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c5a93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744073:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c5a93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744080:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c5a93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744091:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.744092:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.744098:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.744295:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652227.744444:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652227.744450:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c5a9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744458:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.744460:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.744464:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c5a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744473:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c5a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744480:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c5a9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744486:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c5a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744498:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652227.744505:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.744508:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c5a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744514:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.744517:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c5a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744534:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c5a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744544:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c5a9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744551:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c5a9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.744563:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.744565:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.744566:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.744793:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.744799:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c5aa1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.744807:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.744810:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.744821:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c5aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.744830:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c5aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.744837:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c5aa1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.744844:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c5aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.744863:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652227.745032:0:25159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652227.745038:0:25159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c5aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.745047:0:25159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652227.745050:0:25159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c5aa1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.745070:0:25159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c5aa1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.745082:0:25159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c5aa1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.745089:0:25159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c5aa1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.745101:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.745103:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.745105:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.745175:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.745180:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5aa8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788652227.745183:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.745188:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=683s v=(0 0) 00010000:00010000:0.0:1788652227.745188:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a17cea4c/0xcd2f56ea038c5aaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.745191:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.745195:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.745196:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.745198:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652227.745202:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a17cea4c/0xcd2f56ea038c5aaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.745205:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.745211:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a17cea4c/0xcd2f56ea038c5aaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.745214:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5aa8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.745219:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a17cea4c/0xcd2f56ea038c5aaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.745231:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5aa8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.745232:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a17cea4c/0xcd2f56ea038c5aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.745245:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788652227.745594:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3d35ae5/0xcd2f56ea038c5a70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745603:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dda00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.745607:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d35ae5/0xcd2f56ea038c5a70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745614:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3d35ae5/0xcd2f56ea038c5a70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745630:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3d35ae5/0xcd2f56ea038c5a70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745637:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3d35ae5/0xcd2f56ea038c5a70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745650:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652227.745653:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a17cea4c/0xcd2f56ea038c5aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745658:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.745661:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a17cea4c/0xcd2f56ea038c5aaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745668:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a17cea4c/0xcd2f56ea038c5aaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745676:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a17cea4c/0xcd2f56ea038c5aaf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745681:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a17cea4c/0xcd2f56ea038c5aaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745704:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652227.745707:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5aa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745718:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.745721:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5aa8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745729:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5aa8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745739:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5aa8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.745747:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.745749:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.746372:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788652227.746380:0:24258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5aa8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.746535:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.746565:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.747174:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.747182:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000199b8cbd/0xcd2f56ea038c5ab6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.747195:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.747199:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.747205:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000199b8cbd/0xcd2f56ea038c5ab6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.747219:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000199b8cbd/0xcd2f56ea038c5ab6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.747228:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000199b8cbd/0xcd2f56ea038c5ab6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.747236:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000199b8cbd/0xcd2f56ea038c5ab6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747272:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.747278:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000199b8cbd/0xcd2f56ea038c5ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747286:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.747290:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000199b8cbd/0xcd2f56ea038c5ab6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747300:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000199b8cbd/0xcd2f56ea038c5ab6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747314:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000199b8cbd/0xcd2f56ea038c5ab6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747323:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.747325:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.747326:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.747333:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.747339:0:24258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000199b8cbd/0xcd2f56ea038c5ab6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652227.747600:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1788652227.747603:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652227.747606:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035596daa/0xcd2f56ea038c5abd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.747607:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a164e691/0xcd2f56ea038c5ac4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.747616:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=683s v=(0 0) 00010000:00010000:2.0:1788652227.747616:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.747620:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652227.747620:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.747625:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a164e691/0xcd2f56ea038c5ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.747625:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035596daa/0xcd2f56ea038c5abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.747635:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a164e691/0xcd2f56ea038c5ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.747636:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035596daa/0xcd2f56ea038c5abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.747644:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a164e691/0xcd2f56ea038c5ac4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.747645:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035596daa/0xcd2f56ea038c5abd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.747651:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a164e691/0xcd2f56ea038c5ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.747659:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035596daa/0xcd2f56ea038c5abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.747663:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652227.747674:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788652227.747791:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652227.747796:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a164e691/0xcd2f56ea038c5ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747814:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.747817:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a164e691/0xcd2f56ea038c5ac4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747825:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a164e691/0xcd2f56ea038c5ac4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747837:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a164e691/0xcd2f56ea038c5ac4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747845:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a164e691/0xcd2f56ea038c5ac4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747859:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.747862:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035596daa/0xcd2f56ea038c5abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747868:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23ddc00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.747871:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035596daa/0xcd2f56ea038c5abd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747878:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035596daa/0xcd2f56ea038c5abd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747888:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035596daa/0xcd2f56ea038c5abd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747900:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035596daa/0xcd2f56ea038c5abd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.747941:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.747943:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.747945:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.747949:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.748104:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.748115:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5acb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.748123:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.748126:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.748130:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5acb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.748140:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5acb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.748148:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5acb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.748156:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5acb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.748174:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788652227.748521:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.748527:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6380126/0xcd2f56ea038c5ad2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.748535:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.748538:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.748542:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c6380126/0xcd2f56ea038c5ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.748552:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c6380126/0xcd2f56ea038c5ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.748565:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c6380126/0xcd2f56ea038c5ad2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.748572:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c6380126/0xcd2f56ea038c5ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.748584:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788652227.748634:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652227.748640:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5acb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.748648:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.748652:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5acb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.748661:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5acb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.748674:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5acb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.748702:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5acb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.748884:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652227.748888:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c6380126/0xcd2f56ea038c5ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.748896:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652227.748900:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6380126/0xcd2f56ea038c5ad2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.748927:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c6380126/0xcd2f56ea038c5ad2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.748938:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c6380126/0xcd2f56ea038c5ad2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.748946:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6380126/0xcd2f56ea038c5ad2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.748960:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.748962:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.748963:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652227.749006:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:3.0:1788652227.749011:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.749017:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c5ae0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749018:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e504c70/0xcd2f56ea038c5ad9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.749026:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=683s v=(0 0) 00010000:00010000:2.0:1788652227.749026:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.749030:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652227.749030:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.749035:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c5ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749035:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e504c70/0xcd2f56ea038c5ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749045:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e504c70/0xcd2f56ea038c5ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.749046:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c5ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.749055:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c5ae0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749055:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e504c70/0xcd2f56ea038c5ad9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.749064:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c5ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749064:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e504c70/0xcd2f56ea038c5ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749076:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.749081:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788652227.749083:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652227.749086:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e504c70/0xcd2f56ea038c5ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749091:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652227.749094:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e504c70/0xcd2f56ea038c5ad9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749101:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e504c70/0xcd2f56ea038c5ad9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749117:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e504c70/0xcd2f56ea038c5ad9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749125:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e504c70/0xcd2f56ea038c5ad9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749138:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652227.749142:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c5ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749149:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652227.749152:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c5ae0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.749155:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.749160:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c5ae0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749170:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c5ae0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749177:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c5ae0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749189:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.749191:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.749198:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.749567:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.749573:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c5ae7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.749581:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.749585:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.749589:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c5ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.749598:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c5ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788652227.749603:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.749606:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c5ae7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.749608:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5aee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.749614:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c5ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.749616:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788652227.749619:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652227.749623:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5aee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.749629:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788652227.749631:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5aee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.749639:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5aee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.749646:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5aee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.749656:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788652227.749981:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652227.749987:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c5ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.749995:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652227.749999:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c5ae7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.750007:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c5ae7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788652227.750252:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.750258:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c5af5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.750284:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652227.750290:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5aee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.750297:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652227.750300:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5aee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.750308:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5aee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.750322:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5aee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.750330:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a5d07eeb/0xcd2f56ea038c5aee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652227.750345:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.750347:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.750349:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.750496:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.750506:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.750511:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c5af5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.750521:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c5af5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.750529:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c5af5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.750536:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c5af5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.750555:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652227.750576:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c5ae7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.750583:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c5ae7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.750598:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652227.750601:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c5af5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.750607:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652227.750610:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c5af5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.750618:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c5af5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.750634:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c5af5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.750641:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c5af5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.750654:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.750655:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.750658:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.750664:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652227.750845:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652227.750851:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002b39545/0xcd2f56ea038c5afc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.750859:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=683s v=(0 0) 00010000:00010000:2.0:1788652227.750862:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652227.750866:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002b39545/0xcd2f56ea038c5afc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.750875:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002b39545/0xcd2f56ea038c5afc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.750883:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002b39545/0xcd2f56ea038c5afc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.750891:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002b39545/0xcd2f56ea038c5afc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.750954:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.751044:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.751049:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5b03 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751057:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.751060:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.751064:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751073:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751081:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5b03 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751092:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751104:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788652227.751411:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.751417:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5b0a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751425:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.751427:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.751431:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751440:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751448:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5b0a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751454:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751466:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788652227.751695:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.751701:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5b11 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751714:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.751717:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.751721:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751730:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751738:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5b11 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751745:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5b11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751759:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788652227.751768:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788652227.751772:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751952:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.751957:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5b03 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751967:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5b03 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.751992:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5b03 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752012:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5b03 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752029:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788652227.752032:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752038:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.752042:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5b0a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752050:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5b0a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752061:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5b0a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752069:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5b0a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752080:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.752084:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5b11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752096:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.752099:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5b11 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752107:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5b11 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752117:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5b11 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752126:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5b11 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752138:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.752139:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.752141:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.752484:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.752490:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5b18 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752499:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.752502:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.752506:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752516:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752531:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5b18 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752538:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752551:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.752558:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.752562:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752568:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.752572:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5b18 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752579:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5b18 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752590:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5b18 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752597:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c5b18 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.752606:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.752609:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.752618:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002b39545/0xcd2f56ea038c5afc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752625:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dcc00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.752627:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b39545/0xcd2f56ea038c5afc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752635:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002b39545/0xcd2f56ea038c5afc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752646:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002b39545/0xcd2f56ea038c5afc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752653:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002b39545/0xcd2f56ea038c5afc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.752666:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.752668:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.752670:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.752731:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.752737:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652227.753002:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652227.753008:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acdc5389/0xcd2f56ea038c5b1f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.753016:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=683s v=(0 0) 00010000:00010000:2.0:1788652227.753019:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652227.753023:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acdc5389/0xcd2f56ea038c5b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.753033:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acdc5389/0xcd2f56ea038c5b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.753041:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000acdc5389/0xcd2f56ea038c5b1f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.753049:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000acdc5389/0xcd2f56ea038c5b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.753065:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652227.753149:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652227.753155:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000acdc5389/0xcd2f56ea038c5b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.753162:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652227.753165:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000acdc5389/0xcd2f56ea038c5b1f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.753181:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000acdc5389/0xcd2f56ea038c5b1f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.753192:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000acdc5389/0xcd2f56ea038c5b1f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.753198:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acdc5389/0xcd2f56ea038c5b1f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.753211:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.753213:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652227.753215:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652227.753574:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.753580:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c5b26 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.753589:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.753592:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.753597:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c5b26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.753607:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c5b26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.753616:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c5b26 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.753630:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c5b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.753643:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788652227.754165:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.754172:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5b2d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.754182:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.754185:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.754189:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5b2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.754199:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5b2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.754207:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5b2d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.754215:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5b2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.754229:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788652227.755404:0:24256:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652227.755414:0:24256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c5b34 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.755431:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=683s v=(0 0) 00010000:00010000:3.0:1788652227.755435:0:24256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652227.755441:0:24256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c5b34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.755452:0:24256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c5b34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.755461:0:24256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c5b34 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.755467:0:24256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c5b34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652227.755481:0:24256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788652227.755704:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788652227.755715:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c5b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755732:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.755738:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c5b26 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755750:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c5b26 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755770:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c5b26 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755778:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c5b26 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755799:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652227.755803:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5b2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755810:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.755813:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5b2d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755821:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5b2d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755830:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5b2d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755845:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5b2d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755858:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652227.755861:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c5b34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755867:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.755870:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c5b34 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755878:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c5b34 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755889:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c5b34 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755895:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c5b34 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.755931:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.755933:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.755934:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652227.755995:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.756097:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788652227.756239:0:24256:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:0.0:1788652227.756341:0:24256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22777:x1875537147724928:12345-0@lo:5:osp-pre-1-0.0 Request processed in 66039us (68220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652227.756351:0:24256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788652227.756846:0:22777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22777:1875537147724928:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788652227.756863:0:22777:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1788652227.756948:0:22777:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22777:1875537147725824:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788652227.756983:0:22777:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652227.757003:0:22777:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3904180 going to sleep for 11 seconds 00002000:00010000:1.0:1788652227.757222:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788652227.757230:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000215eed66/0xcd2f56ea038c5b3b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.757247:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788652227.757251:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652227.757257:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000215eed66/0xcd2f56ea038c5b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.757269:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000215eed66/0xcd2f56ea038c5b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.757279:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000215eed66/0xcd2f56ea038c5b3b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.757286:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000215eed66/0xcd2f56ea038c5b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.757307:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788652227.757370:0:24745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147725824 00000100:00100000:3.0:1788652227.757377:0:24745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147725824 00000100:00100000:3.0:1788652227.757417:0:24745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788652227.757426:0:24745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22777:x1875537147725824:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788652227.757463:0:24745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:2.0:1788652227.757585:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652227.757590:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000215eed66/0xcd2f56ea038c5b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.757599:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652227.757603:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000215eed66/0xcd2f56ea038c5b3b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.757613:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000215eed66/0xcd2f56ea038c5b3b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.757628:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000215eed66/0xcd2f56ea038c5b3b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.757635:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000215eed66/0xcd2f56ea038c5b3b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.757652:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.757653:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.757655:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652227.758057:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652227.758064:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e504c70/0xcd2f56ea038c5b42 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.758082:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=683s v=(0 0) 00010000:00010000:2.0:1788652227.758086:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652227.758090:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e504c70/0xcd2f56ea038c5b42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.758101:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e504c70/0xcd2f56ea038c5b42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.758109:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e504c70/0xcd2f56ea038c5b42 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.758116:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e504c70/0xcd2f56ea038c5b42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.758131:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000001:00080000:2.0:1788652227.758714:0:25074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788652227.758765:0:25074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788652227.758770:0:25074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788652227.759028:0:25157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:23496:x1875537147725696:12345-0@lo:5:osp-pre-1-1.0 Request processed in 37457us (37631us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788652227.759037:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788652227.759078:0:23496:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788652227.759084:0:23496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23496:1875537147725696:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788652227.759095:0:23496:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:1.0:1788652227.759139:0:23496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23496:1875537147725952:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788652227.759171:0:23496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652227.759189:0:23496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef240 going to sleep for 11 seconds 00002000:00010000:1.0:1788652227.759243:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788652227.759249:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5b49 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.759261:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=683s v=(0 0) 00010000:00010000:1.0:1788652227.759265:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652227.759270:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5b49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.759281:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5b49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.759290:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5b49 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.759298:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5b49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.759311:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1788652227.759629:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147725952 00000100:00100000:2.0:1788652227.759636:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147725952 00000100:00100000:2.0:1788652227.759672:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788652227.759679:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23496:x1875537147725952:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788652227.759740:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23496:x1875537147725952:12345-0@lo:900:osp-pre-1-1.0 Request processed in 61us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652227.759747:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788652227.759781:0:23496:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d2d80 x1875537147725952/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788652243 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652227.759792:0:23496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23496:1875537147725952:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788652227.759816:0:25159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652227.759824:0:25159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e504c70/0xcd2f56ea038c5b42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.759832:0:25159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652227.759836:0:25159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e504c70/0xcd2f56ea038c5b42 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.759846:0:25159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e504c70/0xcd2f56ea038c5b42 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.759865:0:25159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e504c70/0xcd2f56ea038c5b42 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.759873:0:25159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e504c70/0xcd2f56ea038c5b42 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.759890:0:25159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652227.759893:0:25159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5b49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.759899:0:25159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652227.759901:0:25159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5b49 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.759950:0:25159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5b49 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.759961:0:25159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5b49 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.759968:0:25159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5b49 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.759980:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.759982:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652227.759983:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652227.760358:0:24258:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652227.760365:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c5b50 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.760375:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=683s v=(0 0) 00010000:00010000:2.0:1788652227.760378:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652227.760383:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c5b50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.760393:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c5b50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.760402:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c5b50 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.760418:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c5b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652227.760470:0:24258:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788652227.760738:0:24258:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:2.0:1788652227.760806:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22775:x1875537147725184:12345-0@lo:5:osp-pre-0-0.0 Request processed in 68723us (71608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652227.760815:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788652227.760968:0:22739:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652227.760974:0:22739:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c5b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.760982:0:22739:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652227.760985:0:22739:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c5b50 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.761072:0:22739:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c5b50 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.761088:0:22739:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c5b50 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.761096:0:22739:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c5b50 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652227.761114:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.761116:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.761117:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652227.764271:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652227.764422:0:22775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22775:1875537147725184:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788652227.764441:0:22775:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788652227.764549:0:22775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22775:1875537147726080:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788652227.764603:0:22775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652227.764654:0:22775:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0968300 going to sleep for 11 seconds 00000100:00100000:3.0:1788652227.765417:0:24745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22777:x1875537147725824:12345-0@lo:5:osp-pre-1-0.0 Request processed in 7990us (8431us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788652227.765427:0:24745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788652227.765470:0:22777:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22777:1875537147725824:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788652227.765481:0:22777:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:1.0:1788652227.765712:0:24256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147726080 00000100:00100000:1.0:1788652227.765719:0:24256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147726080 00000100:00100000:3.0:1788652227.765775:0:24745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788652227.765784:0:24745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22775:x1875537147726080:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788652227.765820:0:24745:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:1.0:1788652227.769358:0:24253:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1788652227.769412:0:24253:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788652227.769756:0:24745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22775:x1875537147726080:12345-0@lo:5:osp-pre-0-0.0 Request processed in 3969us (5147us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788652227.769768:0:24745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788652227.769850:0:22775:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788652227.769859:0:22775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22775:1875537147726080:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788652227.769875:0:22775:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:1.0:1788652228.007570:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788652228.259817:0:23505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788652228.512230:0:22748:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788652228.512237:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86c92db800 from 14 10000000:01000000:0.0:1788652228.512242:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788652228.512300:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c5b57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652228.512311:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c5b57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652228.512323:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c5b57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652228.512349:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147726208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652228.512427:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652228.512475:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c30fae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652228.512634:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147726208 00000100:00100000:2.0:1788652228.512643:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147726208 00000100:00100000:2.0:1788652228.512711:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788652228.512722:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+22:22748:x1875537147726208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652228.512738:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652228.512755:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c5b5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5b57 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652228.512792:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c5b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5b57 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652228.512804:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c5b5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5b57 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652228.512826:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd200, rc 0) 00000100:00100000:2.0:1788652228.512878:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+23:22748:x1875537147726208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652228.512884:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788652228.513456:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147726208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652228.513474:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c5b57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5b5e expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652228.513546:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c5b57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5b5e expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652228.513601:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147726336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788652228.513635:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652228.513730:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c30fae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652228.513832:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147726336 00000100:00100000:2.0:1788652228.513838:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147726336 00000100:00100000:2.0:1788652228.513880:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788652228.513887:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+23:22748:x1875537147726336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788652228.514154:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788652228.514169:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788652228.514173:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788652228.514386:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+23:22748:x1875537147726336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 498us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652228.514394:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788652228.514447:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147726336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788652228.514565:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788652228.514573:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c5b57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5b5e expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652228.514583:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c5b57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5b5e expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652228.514592:0:22748:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788652228.514594:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86f3c9f800 from 14 10000000:01000000:0.0:1788652228.514596:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788652228.514619:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c5b65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652228.514627:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c5b65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652228.514636:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c5b65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652228.514650:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147726464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652228.514685:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652228.514711:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c30fae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652228.514745:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147726464 00000100:00100000:2.0:1788652228.514750:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147726464 00000100:00100000:2.0:1788652228.514852:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788652228.514860:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+23:22748:x1875537147726464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652228.514877:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652228.514890:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5b6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5b65 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652228.515172:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5b65 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652228.515185:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c5b6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5b65 expref: 24 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652228.515204:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc600, rc 0) 00000100:00100000:2.0:1788652228.515330:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+24:22748:x1875537147726464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 469us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652228.515337:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788652228.515393:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147726464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652228.515616:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c5b65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5b6c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652228.515626:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c5b65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5b6c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652228.515683:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147726592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788652228.515713:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652228.515836:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c30fae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652228.515872:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147726592 00000100:00100000:2.0:1788652228.515879:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147726592 00000100:00100000:2.0:1788652228.516246:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788652228.516373:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+24:22748:x1875537147726592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788652228.516391:0:22745:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788652228.516407:0:22745:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788652228.516410:0:22745:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:2.0:1788652228.516685:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+24:22748:x1875537147726592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 431us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652228.516693:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788652228.516753:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147726592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788652228.517371:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788652228.517382:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c5b65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5b6c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652228.517392:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c5b65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5b6c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652229.030585:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652230.049669:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652230.629438:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652230.629471:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147726720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788652230.629553:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652230.629617:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147726720 00000100:00100000:1.0:1788652230.629626:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147726720 00000100:00100000:1.0:1788652230.629688:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652230.629697:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147726720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788652230.629734:0:24260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788652230.629787:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147726720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652230.629794:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788652230.629812:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652230.629854:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147726720:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788652231.072243:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652231.137501:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652231.137526:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147726848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652231.137598:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652231.137660:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147726848 00000100:00100000:3.0:1788652231.137669:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147726848 00000100:00100000:3.0:1788652231.137719:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788652231.137728:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147726848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788652231.137762:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788652231.137811:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147726848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652231.137818:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788652231.137863:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147726848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788652231.657988:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652231.658012:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147726976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788652231.658192:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652231.661241:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147726976 00000100:00100000:0.0:1788652231.661260:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147726976 00000100:00100000:0.0:1788652231.661331:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788652231.661341:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147726976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788652231.661381:0:23492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788652231.661549:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147726976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 210us (3357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652231.661557:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788652231.664818:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147726976:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788652232.096179:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788652232.882716:0:25432:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788652233.124021:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652233.191460:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f967659c-eb6d-423b-8189-3d2637ee2451:3637:1875537147727104:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.191645:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652233.191691:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147727104 00000100:00100000:1.0:1788652233.191702:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147727616:0@lo:400:kworker.0 00000100:00100000:2.0:1788652233.191703:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147727104 00000100:00100000:1.0:1788652233.191742:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652233.191766:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788652233.191770:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147728128:0@lo:400:kworker.0 00000100:00100000:2.0:1788652233.191780:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+24:3637:x1875537147727104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.191794:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652233.191811:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147728640:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.191845:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652233.191850:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+24:3637:x1875537147727104:12345-0@lo:400:kworker.0 Request processed in 72us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652233.191861:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788652233.191893:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f967659c-eb6d-423b-8189-3d2637ee2451:3637:1875537147727104:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.192024:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788652233.192033:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147727232:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.192066:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652233.192092:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147727744:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.192116:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652233.192135:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147728256:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.192155:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652233.192174:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147728768:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788652233.192177:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147727232 00000100:00100000:2.0:1788652233.192183:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147727232 00000100:00100000:1.0:1788652233.192201:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652233.192220:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147727744 00000100:00100000:2.0:1788652233.192224:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147727744 00000100:00100000:1.0:1788652233.192236:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147727360:0@lo:400:kworker.0 00000100:00100000:2.0:1788652233.192243:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788652233.192251:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147727232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.192269:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652233.192293:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147727872:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.192317:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652233.192420:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147727232:12345-0@lo:400:kworker.0 Request processed in 169us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652233.192428:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788652233.192444:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788652233.192451:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147727744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652233.192489:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147727744:12345-0@lo:400:kworker.0 Request processed in 39us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652233.192495:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788652233.192740:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147728384:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.192766:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652233.192777:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147728896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652233.192797:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652233.192829:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788652233.192835:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147727488:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.192855:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652233.192874:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147728000:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.192891:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652233.192933:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147728512:0@lo:400:kworker.0 00000100:00100000:2.0:1788652233.192941:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147728768 00000100:00100000:2.0:1788652233.192947:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147728768 00000100:00100000:1.0:1788652233.192962:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652233.192975:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147729024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652233.192984:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147728896 00000100:00100000:2.0:1788652233.192989:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147728896 00000100:00100000:1.0:1788652233.192998:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652233.193025:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147729024 00000100:00100000:2.0:1788652233.193029:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147729024 00000100:00100000:1.0:1788652233.193048:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147727616 00000100:00100000:2.0:1788652233.193054:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652233.193057:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147727616 00000100:00100000:2.0:1788652233.193063:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147728768:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788652233.193088:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147728128 00002000:00000024:2.0:1788652233.193094:0:24261:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788652233.193094:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147728128 00000100:00100000:1.0:1788652233.193110:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147728640 00000100:00100000:1.0:1788652233.193115:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147728640 00000100:00100000:1.0:1788652233.193135:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147728256 00000100:00100000:1.0:1788652233.193138:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147728256 00000100:00100000:2.0:1788652233.193142:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147728768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652233.193150:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652233.193156:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147728384 00000100:00100000:1.0:1788652233.193160:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147728384 00000100:00100000:2.0:1788652233.193169:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652233.193179:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875537147728896:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652233.193181:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147728512 00000100:00100000:1.0:1788652233.193185:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147728512 00002000:00000024:2.0:1788652233.193190:0:24261:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788652233.193206:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788652233.193216:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147727616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652233.193226:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875537147728896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652233.193232:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652233.193253:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788652233.193260:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147729024:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652233.193262:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147727616:12345-0@lo:400:kworker.0 Request processed in 47us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652233.193273:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00002000:00000024:2.0:1788652233.193283:0:24261:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788652233.193292:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788652233.193301:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147728128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652233.193317:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147729024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 57us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652233.193324:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788652233.193341:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147728128:12345-0@lo:400:kworker.0 Request processed in 41us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652233.193349:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788652233.193362:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788652233.193368:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147728640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.193395:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147728640:12345-0@lo:400:kworker.0 Request processed in 27us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652233.193400:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788652233.193409:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788652233.193414:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147728256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.193451:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147728256:12345-0@lo:400:kworker.0 Request processed in 36us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652233.193457:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788652233.193467:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788652233.193473:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147728384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.193498:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147728384:12345-0@lo:400:kworker.0 Request processed in 25us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652233.193504:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788652233.193514:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788652233.193520:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147728512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.193560:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147728512:12345-0@lo:400:kworker.0 Request processed in 40us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652233.193566:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788652233.193630:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147727360 00000100:00100000:1.0:1788652233.193635:0:25157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147727360 00000100:00100000:1.0:1788652233.193660:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147727872 00000100:00100000:1.0:1788652233.193664:0:25157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147727872 00000100:00100000:1.0:1788652233.193677:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147727488 00000100:00100000:1.0:1788652233.193679:0:25157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147727488 00000100:00100000:2.0:1788652233.193691:0:24745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147728000 00000100:00100000:1.0:1788652233.193696:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788652233.193698:0:24745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147728000 00000100:00100000:1.0:1788652233.193705:0:25157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147727360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652233.193726:0:24745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652233.193736:0:24745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efa37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147727872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.193741:0:25157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147727360:12345-0@lo:400:kworker.0 Request processed in 36us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652233.193748:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788652233.193760:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652233.193766:0:25157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3635:x1875537147727488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.193807:0:25157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3635:x1875537147727488:12345-0@lo:400:kworker.0 Request processed in 41us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652233.193813:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652233.193826:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652233.193833:0:25157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147728000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652233.193849:0:24745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efa37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147727872:12345-0@lo:400:kworker.0 Request processed in 113us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652233.193857:0:24745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652233.193869:0:25157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147728000:12345-0@lo:400:kworker.0 Request processed in 36us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652233.193876:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788652233.194224:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788652233.194229:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788652233.194231:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788652233.194233:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788652233.194363:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147727488:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.194376:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147728000:0@lo:400:kworker.0 00010000:00080000:1.0:1788652233.194390:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb53100 x1875537147728512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652233.194402:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147728512:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.194419:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147729024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652233.194428:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147727360:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.194437:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147727872:0@lo:400:kworker.0 00010000:00080000:1.0:1788652233.194447:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb51f80 x1875537147728384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652233.194456:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147728384:0@lo:400:kworker.0 00000100:00100000:1.0:1788652233.194478:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147728896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652233.198856:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147727232:0@lo:400:kworker.0 00000100:00100000:2.0:1788652233.198877:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147727744:0@lo:400:kworker.0 00010000:00080000:2.0:1788652233.198896:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb52300 x1875537147728256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652233.198927:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147728256:0@lo:400:kworker.0 00000100:00100000:2.0:1788652233.198959:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f67af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147728768:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788652233.198974:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb50380 x1875537147727616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652233.198981:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147727616:0@lo:400:kworker.0 00010000:00080000:2.0:1788652233.198993:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb50e00 x1875537147728128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652233.199016:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147728128:0@lo:400:kworker.0 00010000:00080000:2.0:1788652233.199037:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c368c700 x1875537147728640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652233.199046:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147728640:0@lo:400:kworker.0 00000001:00080000:3.0:1788652233.201824:0:25074:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000020:00000004:3.0:1788652233.727889:0:25484:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788652233.728128:0:25484:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788652234.144081:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788652234.595938:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1788652234.662498:0:25534:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788652234.662757:0:25534:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788652234.828882:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652234.829253:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125593344 00000100:00100000:2.0:1788652234.829266:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125593344 00000100:00100000:2.0:1788652234.829311:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 114 00000100:00100000:2.0:1788652234.829321:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2387:x1875537125593344:12345-192.168.204.45@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788652234.829457:0:22745:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d@192.168.204.45@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1788652234.829488:0:22745:0:(genops.c:1385:class_connect()) connect: client bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d, cookie 0xcd2f56ea038c5b73 00000100:00080000:2.0:1788652234.829702:0:22745:0:(import.c:65:import_set_state_nolock()) ffff8f86d12ad800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652234.829974:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+5:2387:x1875537125593344:12345-192.168.204.45@tcp:250:mount.lustre.0 Request processed in 652us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652234.829982:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 114 00000100:00100000:1.0:1788652234.832265:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652234.833308:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125593472 00000100:00100000:2.0:1788652234.833321:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125593472 00000100:00100000:2.0:1788652234.833383:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 115 00000100:00100000:2.0:1788652234.834024:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+5:18132:x1875537125593472:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788652234.834043:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652234.834073:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dc000/0xcd2f56ea038c5b7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe341dd expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652234.834103:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dc000/0xcd2f56ea038c5b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341dd expref: 6 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652234.834124:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dc000/0xcd2f56ea038c5b7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341dd expref: 6 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652234.834136:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc000, rc 0) 00000100:00100000:2.0:1788652234.834199:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+6:18132:x1875537125593472:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 806us (1950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652234.834207:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 115 00000100:00100000:1.0:1788652234.842821:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652234.843289:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125593600 00000100:00100000:3.0:1788652234.843301:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125593600 00000100:00100000:3.0:1788652234.843369:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 116 00000100:00100000:3.0:1788652234.843380:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+6:18132:x1875537125593600:12345-192.168.204.45@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788652234.843533:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+6:18132:x1875537125593600:12345-192.168.204.45@tcp:501:mount.lustre.0 Request processed in 154us (720us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788652234.843541:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 116 00000100:00100000:3.0:1788652234.852415:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652234.853733:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125593728 00000100:00100000:2.0:1788652234.853747:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125593728 00000100:00100000:2.0:1788652234.853798:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 117 00000100:00100000:2.0:1788652234.853808:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcefb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+6:18132:x1875537125593728:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788652234.853829:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652234.853846:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c5b81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe341e4 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652234.853876:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c5b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341e4 expref: 7 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652234.853888:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c5b81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341e4 expref: 7 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652234.853898:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dcc00, rc 0) 00000100:00100000:2.0:1788652234.853974:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcefb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+7:18132:x1875537125593728:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 162us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652234.853983:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 117 00000100:00100000:1.0:1788652234.858035:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652234.858123:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125593856 00000100:00100000:2.0:1788652234.858148:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125593856 00000100:00100000:2.0:1788652234.858239:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 118 00000100:00100000:2.0:1788652234.858250:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+7:18132:x1875537125593856:12345-192.168.204.45@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788652234.858440:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+8:18132:x1875537125593856:12345-192.168.204.45@tcp:501:mount.lustre.0 Request processed in 191us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652234.858448:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 118 00000100:00100000:1.0:1788652234.868413:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652234.868517:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125593984 00000100:00100000:3.0:1788652234.868528:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125593984 00000100:00100000:3.0:1788652234.868602:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 119 00000100:00100000:3.0:1788652234.868613:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcefb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+8:18132:x1875537125593984:12345-192.168.204.45@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788652234.868812:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcefb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+8:18132:x1875537125593984:12345-192.168.204.45@tcp:503:mount.lustre.0 Request processed in 200us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652234.868821:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 119 00000100:00100000:0.0:1788652234.877068:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652234.877120:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125594112 00000100:00100000:2.0:1788652234.877131:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125594112 00000100:00100000:2.0:1788652234.877185:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 120 00000100:00100000:2.0:1788652234.877195:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+8:18150:x1875537125594112:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652234.877430:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+8:18150:x1875537125594112:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 235us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652234.877439:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 120 00000100:00100000:0.0:1788652234.889857:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652234.890250:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125594240 00000100:00100000:3.0:1788652234.890269:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125594240 00000100:00100000:3.0:1788652234.890326:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 121 00000100:00100000:3.0:1788652234.890335:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcefac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+8:18150:x1875537125594240:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788652234.890490:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcefac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+8:18150:x1875537125594240:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 155us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652234.890499:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 121 00000100:00100000:1.0:1788652234.904207:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652234.904630:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125594368 00000100:00100000:2.0:1788652234.904642:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125594368 00000100:00100000:2.0:1788652234.904703:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 122 00000100:00100000:2.0:1788652234.904714:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+8:18150:x1875537125594368:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652234.905106:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+8:18150:x1875537125594368:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 392us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652234.905127:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 122 00000100:00100000:0.0:1788652234.911960:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652234.912300:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125594496 00000100:00100000:3.0:1788652234.912324:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125594496 00000100:00100000:3.0:1788652234.913315:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 123 00000100:00100000:3.0:1788652234.913331:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+8:18132:x1875537125594496:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788652234.913348:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652234.913576:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c5b88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34215 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652234.913613:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c5b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34215 expref: 9 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652234.913626:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c5b88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34215 expref: 9 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652234.913636:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6a00, rc 0) 00000100:00100000:3.0:1788652234.913703:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+9:18132:x1875537125594496:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 376us (1751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652234.913710:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 123 00000100:00100000:0.0:1788652234.917168:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652234.917296:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125594624 00000100:00100000:1.0:1788652234.917308:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125594624 00000100:00100000:1.0:1788652234.917360:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 124 00000100:00100000:1.0:1788652234.917367:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+9:18132:x1875537125594624:12345-192.168.204.45@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788652234.917389:0:22743:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788652234.917414:0:22743:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788652234.917424:0:22743:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788652234.917427:0:22743:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788652234.917430:0:22743:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788652234.917433:0:22743:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788652234.922147:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+9:18132:x1875537125594624:12345-192.168.204.45@tcp:256:mount.lustre.0 Request processed in 4769us (4978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652234.922172:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 124 00000100:00100000:0.0:1788652234.930285:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652234.930473:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125594752 00000100:00100000:3.0:1788652234.930486:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125594752 00000100:00100000:3.0:1788652234.930561:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 125 00000100:00100000:3.0:1788652234.930573:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcefa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+9:18132:x1875537125594752:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788652234.930592:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652234.930611:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c5b8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3421c expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652234.930645:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c5b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3421c expref: 10 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652234.930659:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c5b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3421c expref: 10 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652234.930682:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7a00, rc 0) 00000100:00100000:3.0:1788652234.930757:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcefa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+10:18132:x1875537125594752:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 185us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652234.930765:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 125 00000100:00100000:0.0:1788652234.938054:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652234.938995:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125594880 00000100:00100000:2.0:1788652234.939008:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125594880 00000100:00100000:2.0:1788652234.939101:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 126 00000100:00100000:2.0:1788652234.939112:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+10:18132:x1875537125594880:12345-192.168.204.45@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788652234.939566:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcef9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+10:18132:x1875537125594880:12345-192.168.204.45@tcp:501:mount.lustre.0 Request processed in 454us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652234.939575:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 126 00000100:00100000:1.0:1788652234.948586:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652234.948701:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125595008 00000100:00100000:2.0:1788652234.948713:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125595008 00000100:00100000:2.0:1788652234.948780:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 127 00000100:00100000:2.0:1788652234.948791:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcefbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+10:18132:x1875537125595008:12345-192.168.204.45@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788652234.948992:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcefbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+10:18132:x1875537125595008:12345-192.168.204.45@tcp:503:mount.lustre.0 Request processed in 202us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652234.949001:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 127 00000100:00100000:0.0:1788652234.953422:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652234.953767:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125595136 00000100:00100000:2.0:1788652234.953779:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125595136 00000100:00100000:2.0:1788652234.953836:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 128 00000100:00100000:2.0:1788652234.953847:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c239f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+10:18155:x1875537125595136:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652234.954114:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c239f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+10:18155:x1875537125595136:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 267us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652234.954123:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 128 00000100:00100000:0.0:1788652234.958171:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652234.958350:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125595264 00000100:00100000:3.0:1788652234.958362:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125595264 00000100:00100000:3.0:1788652234.958420:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 129 00000100:00100000:3.0:1788652234.958430:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+10:18155:x1875537125595264:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788652234.958615:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+10:18155:x1875537125595264:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 185us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652234.958623:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 129 00000100:00100000:1.0:1788652234.964101:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652234.964202:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652234.964688:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125595392 00000100:00100000:2.0:1788652234.964700:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125595392 00000100:00100000:2.0:1788652234.964750:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125595648 00000100:00100000:2.0:1788652234.964754:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125595648 00000100:00100000:2.0:1788652234.964782:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:2.0:1788652234.964791:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2387:x1875537125595392:12345-192.168.204.45@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788652234.964824:0:22750:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 1867a2b2-cc26-44de-896f-c5dbaa28edb1@192.168.204.45@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1788652234.964931:0:22750:0:(genops.c:1385:class_connect()) connect: client 1867a2b2-cc26-44de-896f-c5dbaa28edb1, cookie 0xcd2f56ea038c5b96 00000004:00100000:2.0:1788652234.964957:0:22750:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788652234.965158:0:22750:0:(import.c:65:import_set_state_nolock()) ffff8f86d12ae000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652234.965231:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:2387:x1875537125595392:12345-192.168.204.45@tcp:38:mount.lustre.0 Request processed in 439us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652234.965238:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:3.0:1788652234.965365:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:3.0:1788652234.965372:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2387:x1875537125595648:12345-192.168.204.45@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788652234.965391:0:22752:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 1867a2b2-cc26-44de-896f-c5dbaa28edb1@192.168.204.45@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:3.0:1788652234.965446:0:22752:0:(genops.c:1385:class_connect()) connect: client 1867a2b2-cc26-44de-896f-c5dbaa28edb1, cookie 0xcd2f56ea038c5b9d 00000004:00100000:3.0:1788652234.965463:0:22752:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788652234.965624:0:22752:0:(import.c:65:import_set_state_nolock()) ffff8f85c1949000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652234.965653:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:2387:x1875537125595648:12345-192.168.204.45@tcp:38:mount.lustre.0 Request processed in 279us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652234.965660:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:1.0:1788652234.969856:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652234.969895:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652234.970339:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652234.970675:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125595904 00000100:00100000:3.0:1788652234.970676:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125595520 00000100:00100000:3.0:1788652234.970689:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125595520 00000100:00100000:0.0:1788652234.970689:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125595904 00000100:00100000:3.0:1788652234.970806:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:0.0:1788652234.970817:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:3.0:1788652234.970821:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:0:x1875537125595520:12345-192.168.204.45@tcp:41:mount.lustre.0 00000100:00100000:0.0:1788652234.970833:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:18132:x1875537125595904:12345-192.168.204.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788652234.970882:0:22752:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000004:00000024:0.0:1788652234.970883:0:22751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788652234.971005:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:18132:x1875537125595904:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 178us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652234.971014:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00080000:2.0:1788652234.971140:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652234.971294:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:0:x1875537125595520:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 477us (1397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652234.971301:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:1.0:1788652234.974841:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125595776 00000100:00100000:1.0:1788652234.974859:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125595776 00000100:00100000:1.0:1788652234.975127:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00100000:1.0:1788652234.975139:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:0:x1875537125595776:12345-192.168.204.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788652234.975198:0:23985:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652234.975309:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:0:x1875537125595776:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 172us (4970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652234.975317:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00080000:2.0:1788652234.979587:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788652234.985804:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652234.985953:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125596032 00000100:00100000:3.0:1788652234.985965:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125596032 00000100:00100000:3.0:1788652234.986106:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 12 00000100:00100000:3.0:1788652234.986117:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18132:x1875537125596032:12345-192.168.204.45@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788652234.986226:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18132:x1875537125596032:12345-192.168.204.45@tcp:40:mount.lustre.0 Request processed in 109us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652234.986234:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 12 00000100:00100000:3.0:1788652234.989346:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652234.989786:0:24745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125596160 00000100:00100000:2.0:1788652234.989796:0:24745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125596160 00000100:00100000:2.0:1788652234.989850:0:24745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:2.0:1788652234.989867:0:24745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2387:x1875537125596160:12345-192.168.204.45@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788652234.990734:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00010000:00080000:2.0:1788652234.991099:0:24745:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 1867a2b2-cc26-44de-896f-c5dbaa28edb1@192.168.204.45@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:2.0:1788652234.991145:0:24745:0:(genops.c:1385:class_connect()) connect: client 1867a2b2-cc26-44de-896f-c5dbaa28edb1, cookie 0xcd2f56ea038c5ba4 00002000:00100000:2.0:1788652234.991159:0:24745:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1867a2b2-cc26-44de-896f-c5dbaa28edb1/ffff8f86d12a8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788652234.991171:0:24745:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788652234.991364:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125596416 00000100:00100000:1.0:1788652234.991374:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125596416 00000100:00100000:1.0:1788652234.991417:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:1.0:1788652234.991425:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18132:x1875537125596416:12345-192.168.204.45@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788652234.991506:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18132:x1875537125596416:12345-192.168.204.45@tcp:900:mount.lustre.0 Request processed in 81us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652234.991514:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:0.0:1788652234.991729:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00002000:00080000:2.0:1788652234.992501:0:24745:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788652234.992536:0:24745:0:(import.c:65:import_set_state_nolock()) ffff8f86d12aa000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652234.992661:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125596288 00000100:00100000:1.0:1788652234.992669:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125596288 00000100:00100000:1.0:1788652234.992707:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:1.0:1788652234.992713:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1875537125596288:12345-192.168.204.45@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788652234.992740:0:24258:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 1867a2b2-cc26-44de-896f-c5dbaa28edb1@192.168.204.45@tcp t0 exp 0000000000000000 cur 690 last 0 00000020:00000080:1.0:1788652234.992763:0:24258:0:(genops.c:1385:class_connect()) connect: client 1867a2b2-cc26-44de-896f-c5dbaa28edb1, cookie 0xcd2f56ea038c5bab 00002000:00100000:1.0:1788652234.992772:0:24258:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1867a2b2-cc26-44de-896f-c5dbaa28edb1/ffff8f85c318e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788652234.992781:0:24258:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788652234.992941:0:24258:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788652234.992958:0:24258:0:(import.c:65:import_set_state_nolock()) ffff8f85c318b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652234.993971:0:24745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:2387:x1875537125596160:12345-192.168.204.45@tcp:8:mount.lustre.0 Request processed in 3689us (4214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652234.993981:0:24745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:1.0:1788652234.994658:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:2387:x1875537125596288:12345-192.168.204.45@tcp:8:mount.lustre.0 Request processed in 288us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652234.994685:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:1.0:1788652234.998742:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652234.998895:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125596544 00000100:00100000:3.0:1788652234.998925:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125596544 00000100:00100000:3.0:1788652234.998984:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:3.0:1788652234.998995:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18132:x1875537125596544:12345-192.168.204.45@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788652235.000032:0:22753:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 876us 00000004:00200000:1.0:1788652235.013459:0:22753:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788652235.013808:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18132:x1875537125596544:12345-192.168.204.45@tcp:33:mount.lustre.0 Request processed in 14809us (15071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652235.013826:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 0 00010000:00010000:1.0:1788652235.168090:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652235.318969:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652235.319363:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125596672 00000100:00100000:1.0:1788652235.319373:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125596672 00000100:00100000:1.0:1788652235.319444:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:1.0:1788652235.319454:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18178:x1875537125596672:12345-192.168.204.45@tcp:101:mkdir.0 00010000:00010000:1.0:1788652235.319474:0:23985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652235.319499:0:23985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5bb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3424d expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652235.319577:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5bb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652235.319592:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652235.319608:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652235.319655:0:23985:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788652235.319658:0:23985:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788652235.319698:0:23985:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652235.321184:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5bb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3424d expref: 8 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652235.321214:0:23985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3424d expref: 7 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652235.321223:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374f00) 00010000:00010000:1.0:1788652235.321227:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652235.321230:0:23985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415a00, rc 0) 00000100:00100000:1.0:1788652235.321370:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:18178:x1875537125596672:12345-192.168.204.45@tcp:101:mkdir.0 Request processed in 1915us (2410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652235.321379:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:2.0:1788652235.744222:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147729152:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788652235.744300:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652235.744418:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147729152 00000100:00100000:1.0:1788652235.744428:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147729152 00000100:00100000:1.0:1788652235.744498:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788652235.744509:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147729152:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788652235.744551:0:24261:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788652235.744596:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147729152:12345-0@lo:13:osp-pre-0-1.0 Request processed in 90us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652235.744603:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1788652235.744731:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788652235.744773:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147729152:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788652236.192396:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652236.259323:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652236.259351:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147729280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788652236.259439:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652236.259531:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147729280 00000100:00100000:3.0:1788652236.259540:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147729280 00000100:00100000:3.0:1788652236.259597:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788652236.259607:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147729280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788652236.259644:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788652236.259691:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147729280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652236.259715:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788652236.259816:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147729280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788652236.768254:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147729408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788652236.768343:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652236.768494:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147729408 00000100:00100000:2.0:1788652236.768504:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147729408 00000100:00100000:2.0:1788652236.768583:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788652236.768594:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147729408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788652236.768637:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788652236.768834:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147729408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 241us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652236.768842:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788652236.768947:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147729408:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788652237.217006:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652237.237180:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652237.237361:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125596800 00000100:00100000:1.0:1788652237.237390:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125596800 00000100:00100000:1.0:1788652237.237494:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:1.0:1788652237.237517:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:18231:x1875537125596800:12345-192.168.204.45@tcp:41:lfs.0 00000004:00000024:1.0:1788652237.237557:0:22751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788652237.237659:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:18231:x1875537125596800:12345-192.168.204.45@tcp:41:lfs.0 Request processed in 155us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652237.237667:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00080000:2.0:1788652237.238561:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652237.249742:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652237.249875:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125596928 00000100:00100000:0.0:1788652237.249888:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125596928 00000100:00100000:0.0:1788652237.250011:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:0.0:1788652237.250025:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18231:x1875537125596928:12345-192.168.204.45@tcp:41:lfs.0 00000004:00000024:0.0:1788652237.250072:0:22750:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788652237.250170:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18231:x1875537125596928:12345-192.168.204.45@tcp:41:lfs.0 Request processed in 149us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652237.250178:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00080000:2.0:1788652237.250260:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788652237.255456:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652237.255610:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125597056 00000100:00100000:2.0:1788652237.255622:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125597056 00000100:00100000:2.0:1788652237.255698:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:2.0:1788652237.255709:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18231:x1875537125597056:12345-192.168.204.45@tcp:13:lfs.0 00002000:00000024:2.0:1788652237.255750:0:24261:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788652237.255872:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18231:x1875537125597056:12345-192.168.204.45@tcp:13:lfs.0 Request processed in 165us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.255880:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00080000:1.0:1788652237.256861:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652237.259376:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652237.259591:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125597184 00000100:00100000:2.0:1788652237.259604:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125597184 00000100:00100000:2.0:1788652237.259676:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00100000:2.0:1788652237.259687:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18231:x1875537125597184:12345-192.168.204.45@tcp:13:lfs.0 00002000:00000024:2.0:1788652237.259735:0:24261:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788652237.259836:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18231:x1875537125597184:12345-192.168.204.45@tcp:13:lfs.0 Request processed in 150us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.259844:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00080000:1.0:1788652237.260116:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652237.444753:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652237.444943:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125597312 00000100:00100000:2.0:1788652237.444954:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125597312 00000100:00100000:2.0:1788652237.445025:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 130 00000100:00100000:2.0:1788652237.445037:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+10:18266:x1875537125597312:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788652237.445063:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652237.445085:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c5bc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34254 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652237.445120:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c5bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34254 expref: 11 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652237.445134:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c5bc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34254 expref: 11 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652237.445145:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dda00, rc 0) 00000100:00100000:2.0:1788652237.445220:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18266:x1875537125597312:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 186us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.445228:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 130 00000100:00100000:3.0:1788652237.453287:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652237.454011:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125597440 00000100:00100000:2.0:1788652237.454024:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125597440 00000100:00100000:2.0:1788652237.454094:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 131 00000100:00100000:2.0:1788652237.454108:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18266:x1875537125597440:12345-192.168.204.45@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788652237.454517:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18266:x1875537125597440:12345-192.168.204.45@tcp:501:mount.lustre.0 Request processed in 411us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.454541:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 131 00000100:00100000:1.0:1788652237.464255:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652237.464350:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125597568 00000100:00100000:3.0:1788652237.464362:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125597568 00000100:00100000:3.0:1788652237.464421:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 132 00000100:00100000:3.0:1788652237.464433:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18266:x1875537125597568:12345-192.168.204.45@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788652237.464704:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18266:x1875537125597568:12345-192.168.204.45@tcp:503:mount.lustre.0 Request processed in 273us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652237.464713:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 132 00000100:00100000:3.0:1788652237.478288:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652237.478992:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125597696 00000100:00100000:2.0:1788652237.479004:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125597696 00000100:00100000:2.0:1788652237.479114:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 133 00000100:00100000:2.0:1788652237.479126:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18270:x1875537125597696:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652237.479300:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18270:x1875537125597696:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 177us (1021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.479309:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 133 00000100:00100000:0.0:1788652237.512075:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652237.512159:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125597824 00000100:00100000:3.0:1788652237.512171:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125597824 00000100:00100000:3.0:1788652237.512233:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 134 00000100:00100000:3.0:1788652237.512243:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18270:x1875537125597824:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788652237.512413:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18270:x1875537125597824:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 171us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652237.512423:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 134 00000100:00100000:3.0:1788652237.514040:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652237.514308:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125597952 00000100:00100000:2.0:1788652237.514317:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125597952 00000100:00100000:2.0:1788652237.514365:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 135 00000100:00100000:2.0:1788652237.514374:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18270:x1875537125597952:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652237.514513:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18270:x1875537125597952:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 139us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.514522:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 135 00000100:00100000:0.0:1788652237.521412:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652237.521602:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125598080 00000100:00100000:1.0:1788652237.521615:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125598080 00000100:00100000:1.0:1788652237.521687:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 136 00000100:00100000:1.0:1788652237.521698:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c384d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18266:x1875537125598080:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788652237.521714:0:22743:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652237.521735:0:22743:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c5bc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34285 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652237.521771:0:22743:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c5bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34285 expref: 12 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652237.521783:0:22743:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c5bc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34285 expref: 12 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652237.521794:0:22743:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415800, rc 0) 00000100:00100000:1.0:1788652237.521869:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c384d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+12:18266:x1875537125598080:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 173us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652237.521893:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 136 00000100:00100000:0.0:1788652237.527690:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652237.527787:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125598208 00000100:00100000:3.0:1788652237.527799:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125598208 00000100:00100000:3.0:1788652237.527865:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 137 00000100:00100000:3.0:1788652237.527875:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c384fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+12:18266:x1875537125598208:12345-192.168.204.45@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788652237.527961:0:22744:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788652237.528206:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788652237.528211:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788652237.528214:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788652237.528217:0:22744:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788652237.528219:0:22744:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788652237.530739:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c384fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+12:18266:x1875537125598208:12345-192.168.204.45@tcp:256:mount.lustre.0 Request processed in 2854us (3049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.530753:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 137 00000100:00100000:0.0:1788652237.535770:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652237.535934:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125598336 00000100:00100000:2.0:1788652237.535946:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125598336 00000100:00100000:2.0:1788652237.537868:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 138 00000100:00100000:2.0:1788652237.537892:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c384f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+12:18266:x1875537125598336:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788652237.537948:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652237.537972:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c5bce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3428c expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652237.538131:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c5bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3428c expref: 13 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652237.538143:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c5bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3428c expref: 13 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652237.538155:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dce00, rc 0) 00000100:00100000:2.0:1788652237.538239:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c384f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18266:x1875537125598336:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 357us (2480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.538249:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 138 00000100:00100000:3.0:1788652237.540318:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652237.540399:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125598464 00000100:00100000:2.0:1788652237.540411:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125598464 00000100:00100000:2.0:1788652237.540468:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 139 00000100:00100000:2.0:1788652237.540478:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f87020ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18266:x1875537125598464:12345-192.168.204.45@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788652237.547613:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f87020ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18266:x1875537125598464:12345-192.168.204.45@tcp:501:mount.lustre.0 Request processed in 7121us (7302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.547631:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 139 00000100:00100000:3.0:1788652237.550162:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652237.550376:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125598592 00000100:00100000:2.0:1788652237.550387:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125598592 00000100:00100000:2.0:1788652237.550483:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 140 00000100:00100000:2.0:1788652237.550494:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18266:x1875537125598592:12345-192.168.204.45@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788652237.550663:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18266:x1875537125598592:12345-192.168.204.45@tcp:503:mount.lustre.0 Request processed in 171us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.550671:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 140 00000100:00100000:0.0:1788652237.553652:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652237.553767:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125598720 00000100:00100000:2.0:1788652237.553785:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125598720 00000100:00100000:2.0:1788652237.553899:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 141 00000100:00100000:2.0:1788652237.553947:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18275:x1875537125598720:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652237.554100:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18275:x1875537125598720:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 191us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.554109:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 141 00000100:00100000:0.0:1788652237.556624:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652237.556709:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125598848 00000100:00100000:2.0:1788652237.556718:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125598848 00000100:00100000:2.0:1788652237.556774:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 142 00000100:00100000:2.0:1788652237.556785:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18275:x1875537125598848:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652237.557355:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18275:x1875537125598848:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 570us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.557363:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 142 00000100:00100000:3.0:1788652237.579467:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652237.579650:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652237.580065:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125598976 00000100:00100000:1.0:1788652237.580079:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125598976 00000100:00100000:1.0:1788652237.580138:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125599232 00000100:00100000:1.0:1788652237.580142:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125599232 00000100:00100000:1.0:1788652237.580214:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:1.0:1788652237.580328:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2387:x1875537125598976:12345-192.168.204.45@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788652237.580379:0:22751:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from bfcf836d-8d6b-40c7-adfd-767bab831a9a@192.168.204.45@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1788652237.580436:0:22751:0:(genops.c:1385:class_connect()) connect: client bfcf836d-8d6b-40c7-adfd-767bab831a9a, cookie 0xcd2f56ea038c5bd5 00000004:00100000:1.0:1788652237.580472:0:22751:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788652237.580596:0:22751:0:(import.c:65:import_set_state_nolock()) ffff8f85c31c7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652237.580682:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:2387:x1875537125598976:12345-192.168.204.45@tcp:38:mount.lustre.0 Request processed in 458us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652237.580690:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:1.0:1788652237.580713:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:1.0:1788652237.580718:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2387:x1875537125599232:12345-192.168.204.45@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788652237.580735:0:22751:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from bfcf836d-8d6b-40c7-adfd-767bab831a9a@192.168.204.45@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:1.0:1788652237.580760:0:22751:0:(genops.c:1385:class_connect()) connect: client bfcf836d-8d6b-40c7-adfd-767bab831a9a, cookie 0xcd2f56ea038c5bdc 00000004:00100000:1.0:1788652237.580776:0:22751:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788652237.580858:0:22751:0:(import.c:65:import_set_state_nolock()) ffff8f86f6ea3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652237.580885:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:2387:x1875537125599232:12345-192.168.204.45@tcp:38:mount.lustre.0 Request processed in 166us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652237.580892:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:0.0:1788652237.600620:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652237.600656:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652237.600952:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125599360 00000100:00100000:2.0:1788652237.600963:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125599360 00000100:00100000:2.0:1788652237.601022:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125599104 00000100:00100000:2.0:1788652237.601024:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125599104 00000100:00100000:2.0:1788652237.601050:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:2.0:1788652237.601060:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:0:x1875537125599360:12345-192.168.204.45@tcp:41:mount.lustre.0 00000100:00100000:0.0:1788652237.601165:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:0.0:1788652237.601175:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:0:x1875537125599104:12345-192.168.204.45@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788652237.601195:0:22751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788652237.601285:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:0:x1875537125599104:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 112us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652237.601293:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00080000:1.0:1788652237.601448:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788652237.601453:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:2.0:1788652237.601876:0:22750:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788652237.601936:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:0:x1875537125599360:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 876us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.601943:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:1.0:1788652237.609680:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652237.611328:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125599488 00000100:00100000:0.0:1788652237.611343:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125599488 00000100:00100000:0.0:1788652237.611428:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:0.0:1788652237.611439:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:18266:x1875537125599488:12345-192.168.204.45@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788652237.611471:0:22751:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788652237.611569:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:18266:x1875537125599488:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 132us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652237.611576:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:2.0:1788652237.614100:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652237.614519:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125599616 00000100:00100000:0.0:1788652237.614535:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125599616 00000100:00100000:0.0:1788652237.614608:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:0.0:1788652237.614619:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:18266:x1875537125599616:12345-192.168.204.45@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788652237.614758:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:18266:x1875537125599616:12345-192.168.204.45@tcp:40:mount.lustre.0 Request processed in 139us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652237.614766:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:3.0:1788652237.619419:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652237.619466:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652237.619511:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125600000 00000100:00100000:1.0:1788652237.619523:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125600000 00000100:00100000:3.0:1788652237.619562:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652237.619660:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:1.0:1788652237.619677:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:18266:x1875537125600000:12345-192.168.204.45@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788652237.619786:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:18266:x1875537125600000:12345-192.168.204.45@tcp:900:mount.lustre.0 Request processed in 114us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652237.619795:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:2.0:1788652237.620038:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125599744 00000100:00100000:2.0:1788652237.620044:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125599744 00000100:00100000:2.0:1788652237.620171:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125599872 00000100:00100000:2.0:1788652237.620175:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125599872 00000100:00100000:2.0:1788652237.620401:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:2.0:1788652237.620408:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2387:x1875537125599744:12345-192.168.204.45@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788652237.620441:0:24259:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from bfcf836d-8d6b-40c7-adfd-767bab831a9a@192.168.204.45@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:2.0:1788652237.620481:0:24259:0:(genops.c:1385:class_connect()) connect: client bfcf836d-8d6b-40c7-adfd-767bab831a9a, cookie 0xcd2f56ea038c5be3 00002000:00100000:2.0:1788652237.620508:0:24259:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bfcf836d-8d6b-40c7-adfd-767bab831a9a/ffff8f86d12ac800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788652237.620523:0:24259:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788652237.620601:0:24259:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788652237.620659:0:24259:0:(import.c:65:import_set_state_nolock()) ffff8f86d12ab000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652237.620708:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:2387:x1875537125599744:12345-192.168.204.45@tcp:8:mount.lustre.0 Request processed in 298us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.620715:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:2.0:1788652237.620730:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:2.0:1788652237.620734:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2387:x1875537125599872:12345-192.168.204.45@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788652237.620753:0:24259:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from bfcf836d-8d6b-40c7-adfd-767bab831a9a@192.168.204.45@tcp t0 exp 0000000000000000 cur 693 last 0 00000020:00000080:2.0:1788652237.620770:0:24259:0:(genops.c:1385:class_connect()) connect: client bfcf836d-8d6b-40c7-adfd-767bab831a9a, cookie 0xcd2f56ea038c5bea 00002000:00100000:2.0:1788652237.620776:0:24259:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bfcf836d-8d6b-40c7-adfd-767bab831a9a/ffff8f86d12af800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788652237.620783:0:24259:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788652237.620820:0:24259:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788652237.620835:0:24259:0:(import.c:65:import_set_state_nolock()) ffff8f86d12af000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652237.620859:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:2387:x1875537125599872:12345-192.168.204.45@tcp:8:mount.lustre.0 Request processed in 122us (1296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652237.620866:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:1.0:1788652237.623397:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652237.623633:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125600128 00000100:00100000:0.0:1788652237.623657:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125600128 00000100:00100000:0.0:1788652237.623717:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 1 00000100:00100000:0.0:1788652237.623729:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:18266:x1875537125600128:12345-192.168.204.45@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788652237.624082:0:22754:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788652237.624222:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:18266:x1875537125600128:12345-192.168.204.45@tcp:33:mount.lustre.0 Request processed in 494us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652237.624230:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 1 00000100:00100000:2.0:1788652237.794505:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652237.794598:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125600256 00000100:00100000:0.0:1788652237.794620:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125600256 00000100:00100000:0.0:1788652237.794700:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:0.0:1788652237.794714:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:18298:x1875537125600256:12345-192.168.204.45@tcp:101:mkdir.0 00010000:00010000:0.0:1788652237.794739:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652237.794767:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5bf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe342bd expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652237.794858:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5bf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652237.794873:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652237.794890:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652237.794971:0:22751:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788652237.794975:0:22751:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788652237.794995:0:22751:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652237.795031:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5bf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342bd expref: 8 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652237.795061:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342bd expref: 7 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652237.795069:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374f00) 00010000:00010000:0.0:1788652237.795073:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788652237.795076:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96e00, rc 0) 00000100:00100000:0.0:1788652237.795137:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+7:18298:x1875537125600256:12345-192.168.204.45@tcp:101:mkdir.0 Request processed in 426us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652237.795144:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 22 00010000:00010000:1.0:1788652238.240101:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652238.304156:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147729536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788652238.304236:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652238.304387:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147729536 00000100:00100000:2.0:1788652238.304397:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147729536 00000100:00100000:2.0:1788652238.304470:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788652238.304492:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147729536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788652238.304515:0:24261:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788652238.304562:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147729536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652238.304569:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788652238.304743:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652238.304778:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147729536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788652238.305081:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788652238.305091:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147729664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652238.305122:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652238.305155:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147729664 00000100:00100000:2.0:1788652238.305159:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147729664 00000100:00100000:2.0:1788652238.305189:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788652238.305196:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147729664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788652238.305207:0:24261:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788652238.305238:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147729664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652238.305244:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788652238.305273:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788652238.305290:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147729664:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788652238.305304:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652238.305413:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652238.305422:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147729792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652238.305448:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652238.305847:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147729792 00000100:00100000:2.0:1788652238.305853:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147729792 00000100:00100000:2.0:1788652238.305896:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788652238.305902:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147729792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788652238.305947:0:24261:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788652238.305981:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147729792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652238.305988:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788652238.306187:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788652238.306217:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147729792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652238.307005:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147729920:0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.307055:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652238.307089:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147730432:0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.307116:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652238.307141:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788652238.307146:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147730048:0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.307172:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652238.307192:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147730560:0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.307216:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652238.307247:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147730048 00000100:00100000:2.0:1788652238.307254:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147730048 00000100:00100000:2.0:1788652238.307307:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788652238.307325:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147730048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.307731:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147730048:12345-0@lo:400:kworker.0 Request processed in 415us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652238.307739:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788652238.307780:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147730048:0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.307804:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147729920 00000100:00100000:2.0:1788652238.307808:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147729920 00000100:00100000:2.0:1788652238.307837:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788652238.307844:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+24:3635:x1875537147729920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.307892:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+24:3635:x1875537147729920:12345-0@lo:400:kworker.0 Request processed in 48us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652238.307934:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788652238.307972:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147729920:0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.308026:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147730560 00000100:00100000:2.0:1788652238.308030:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147730560 00000100:00100000:2.0:1788652238.308059:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788652238.308066:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147730560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.308102:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147730560:12345-0@lo:400:kworker.0 Request processed in 37us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652238.308108:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788652238.308135:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147730560:0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.308169:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147730304:0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.308198:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652238.308219:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788652238.308225:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147730176:0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.308246:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652238.308262:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147730688:0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.308281:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652238.308864:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147730304 00000100:00100000:2.0:1788652238.308870:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147730304 00000100:00100000:2.0:1788652238.309198:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788652238.309209:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147730304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.309260:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147730304:12345-0@lo:400:kworker.0 Request processed in 54us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652238.309280:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788652238.309792:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147731072:0@lo:400:kworker.0 00000100:00100000:0.0:1788652238.309838:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652238.309870:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788652238.309874:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147730944:0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.311015:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147730816:0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.311077:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147730176 00000100:00100000:2.0:1788652238.311085:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147730176 00000100:00100000:2.0:1788652238.311124:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147730688 00000100:00100000:2.0:1788652238.311128:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147730688 00000100:00100000:2.0:1788652238.311171:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147731072 00000100:00100000:2.0:1788652238.311174:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147731072 00000100:00100000:2.0:1788652238.311193:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788652238.311202:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147730176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.311260:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147730176:12345-0@lo:400:kworker.0 Request processed in 59us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652238.311267:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788652238.311285:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788652238.311306:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147730688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.311359:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147730688:12345-0@lo:400:kworker.0 Request processed in 55us (3077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652238.311379:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788652238.311401:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788652238.311816:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652238.311868:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147730944 00000100:00100000:0.0:1788652238.311873:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147730944 00000100:00100000:2.0:1788652238.312003:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147731072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652238.312051:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147731072:12345-0@lo:400:kworker.0 Request processed in 51us (2212us total) trans 0 rc 0/0 00000100:00080000:3.0:1788652238.312111:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788652238.312116:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652238.312145:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652238.312182:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147730176:0@lo:400:kworker.0 00000100:00100000:3.0:1788652238.312193:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147730688:0@lo:400:kworker.0 00000100:00100000:3.0:1788652238.312216:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147730304:0@lo:400:kworker.0 00000100:00100000:3.0:1788652238.312258:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147730816 00000100:00100000:3.0:1788652238.312262:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147730816 00000100:00100000:1.0:1788652238.312349:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147730432 00000100:00100000:1.0:1788652238.312354:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147730432 00000100:00100000:1.0:1788652238.312398:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652238.312406:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147730432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652238.312455:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147730432:12345-0@lo:400:kworker.0 Request processed in 50us (5338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652238.312473:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788652238.312525:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff5da300 x1875537147731072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652238.312536:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147731072:0@lo:400:kworker.0 00000100:00100000:1.0:1788652238.312567:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147730432:0@lo:400:kworker.0 00000100:00100000:0.0:1788652238.317759:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788652238.317788:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147730944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652238.317897:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147730944:12345-0@lo:400:kworker.0 Request processed in 123us (7997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652238.317905:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788652238.318047:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147730944:0@lo:400:kworker.0 00000100:00080000:1.0:1788652238.318087:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788652238.318094:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788652238.318721:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788652238.319246:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788652238.319262:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147730816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652238.319622:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147730816:12345-0@lo:400:kworker.0 Request processed in 366us (7475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652238.319630:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788652238.319716:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff5d8a80 x1875537147730816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652238.319727:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff5d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147730816:0@lo:400:kworker.0 00000040:00080000:3.0:1788652238.498088:0:23505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788652239.264144:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652240.288248:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788652240.374874:0:25632:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788652240.866503:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652240.866525:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147731200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788652240.866597:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652240.866941:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147731200 00000100:00100000:1.0:1788652240.866949:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147731200 00000100:00100000:1.0:1788652240.867018:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788652240.867028:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147731200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788652240.867060:0:24261:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788652240.867309:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652240.869004:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147731200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1970us (2398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652240.869017:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000001:00100000:2.0:1788652240.870631:0:24253:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bfcf836d-8d6b-40c7-adfd-767bab831a9a 00000001:00100000:2.0:1788652240.870645:0:24253:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1867a2b2-cc26-44de-896f-c5dbaa28edb1 00000001:00100000:3.0:1788652240.870759:0:25074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bfcf836d-8d6b-40c7-adfd-767bab831a9a 00000001:00100000:3.0:1788652240.870767:0:25074:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1867a2b2-cc26-44de-896f-c5dbaa28edb1 00000001:00100000:2.0:1788652240.871105:0:22730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bfcf836d-8d6b-40c7-adfd-767bab831a9a 00000001:00100000:2.0:1788652240.871113:0:22730:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1867a2b2-cc26-44de-896f-c5dbaa28edb1 00000100:00100000:0.0:1788652240.871264:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147731200:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1788652240.872088:0:23484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of bfcf836d-8d6b-40c7-adfd-767bab831a9a 00000001:00100000:2.0:1788652240.872097:0:23484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1867a2b2-cc26-44de-896f-c5dbaa28edb1 00010000:00010000:1.0:1788652241.316403:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652241.376628:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652241.376653:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147731328:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788652241.376733:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652241.376884:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147731328 00000100:00100000:3.0:1788652241.376893:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147731328 00000100:00100000:3.0:1788652241.377002:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788652241.377013:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147731328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788652241.377057:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788652241.377115:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147731328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652241.377123:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788652241.377553:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147731328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788652241.895252:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147731456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788652241.895336:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652241.898073:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147731456 00000100:00100000:0.0:1788652241.898093:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147731456 00000100:00100000:0.0:1788652241.898164:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788652241.898174:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147731456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788652241.898216:0:23492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788652241.898299:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147731456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 127us (2963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652241.898305:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788652241.899409:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147731456:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788652242.337549:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652243.117424:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652243.117482:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652243.117510:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652243.117532:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652243.117556:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652243.117575:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652243.117596:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652243.117616:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652243.117667:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652243.117698:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125600768 00000100:00100000:0.0:1788652243.117708:0:25157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125600768 00000100:00100000:0.0:1788652243.117777:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125601280 00000100:00100000:0.0:1788652243.117782:0:25157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125601280 00000100:00100000:1.0:1788652243.117802:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125600512 00000100:00100000:0.0:1788652243.117804:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125600896 00000100:00100000:1.0:1788652243.117810:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125600512 00000100:00100000:0.0:1788652243.117810:0:25157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125600896 00000100:00100000:0.0:1788652243.117840:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125601408 00000100:00100000:0.0:1788652243.117843:0:25157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125601408 00000100:00100000:1.0:1788652243.117852:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125601024 00000100:00100000:1.0:1788652243.117858:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125601024 00000100:00100000:0.0:1788652243.117870:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:1.0:1788652243.117881:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125600640 00000100:00100000:0.0:1788652243.117883:0:25157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2389:x1875537125600768:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652243.117885:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125600640 00000100:00100000:0.0:1788652243.117984:0:25157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2389:x1875537125600768:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 105us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652243.118003:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:0.0:1788652243.118022:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:0.0:1788652243.118029:0:25157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:2389:x1875537125601280:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652243.118056:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125601152 00000100:00100000:0.0:1788652243.118061:0:25157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:2389:x1875537125601280:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 30us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.118063:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125601152 00000100:00100000:0.0:1788652243.118072:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:1.0:1788652243.118089:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 44 00000100:00100000:0.0:1788652243.118093:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:1.0:1788652243.118103:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:2389:x1875537125600512:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652243.118108:0:25157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2389:x1875537125600896:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652243.118155:0:25157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2389:x1875537125600896:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 52us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652243.118161:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:0.0:1788652243.118254:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:0.0:1788652243.118263:0:25157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:2389:x1875537125601408:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652243.118288:0:25157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:2389:x1875537125601408:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 26us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652243.118294:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:0.0:1788652243.118316:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 45 00000100:00100000:0.0:1788652243.118323:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:2389:x1875537125601024:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652243.118347:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:2389:x1875537125601024:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 25us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652243.118353:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 45 00000100:00100000:0.0:1788652243.118378:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 46 00000100:00100000:0.0:1788652243.118405:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2389:x1875537125600640:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652243.118431:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2389:x1875537125600640:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 29us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652243.118437:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 46 00000100:00100000:0.0:1788652243.118449:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 47 00000100:00100000:0.0:1788652243.118456:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:2389:x1875537125601152:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652243.118478:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:2389:x1875537125601152:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 23us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652243.118484:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 47 00000100:00100000:0.0:1788652243.118503:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125600384 00000100:00100000:0.0:1788652243.118507:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125600384 00000100:00100000:0.0:1788652243.118538:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 144 00000100:00100000:0.0:1788652243.118545:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:2389:x1875537125600384:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652243.118565:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:2389:x1875537125600384:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 21us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652243.118571:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 144 00000100:00080000:0.0:1788652243.118605:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788652243.118610:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652243.118612:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788652243.118614:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652243.119109:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:2389:x1875537125600512:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 1005us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.119118:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 44 00010000:00010000:3.0:1788652243.360620:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652243.424578:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147731968:0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.424649:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.424696:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147732480:0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.424748:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.424765:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147732992:0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.424787:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.424821:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788652243.424838:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147731584:0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.424867:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.424888:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147732096:0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.424933:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.424950:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147732608:0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.424971:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.424984:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147733120:0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.425001:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.425028:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147732992 00000100:00100000:1.0:1788652243.425037:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147732992 00000100:00100000:1.0:1788652243.425078:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147732096 00000100:00100000:1.0:1788652243.425081:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147732096 00000100:00100000:1.0:1788652243.425093:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147732608 00000100:00100000:1.0:1788652243.425095:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147732608 00000100:00100000:1.0:1788652243.425105:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147733120 00000100:00100000:1.0:1788652243.425107:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147733120 00000100:00100000:1.0:1788652243.425122:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788652243.425130:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147732992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.425183:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147732992:12345-0@lo:400:kworker.0 Request processed in 54us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.425190:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788652243.425207:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788652243.425212:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147732096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.425247:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147732096:12345-0@lo:400:kworker.0 Request processed in 35us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.425254:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788652243.425265:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788652243.425270:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147732608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.425294:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147732608:12345-0@lo:400:kworker.0 Request processed in 24us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.425300:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788652243.425309:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788652243.425314:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147733120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.425336:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147733120:12345-0@lo:400:kworker.0 Request processed in 22us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.425343:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788652243.425377:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147732096:0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.425402:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147732608:0@lo:400:kworker.0 00010000:00080000:1.0:1788652243.425414:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c345a680 x1875537147733120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652243.425423:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147733120:0@lo:400:kworker.0 00000100:00100000:1.0:1788652243.425432:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147732992:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.425540:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147731712:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.425572:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652243.425594:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147732224:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.425614:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652243.425630:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147732736:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.425648:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652243.425665:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788652243.425671:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147731840:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.425693:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652243.425708:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147732352:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.425727:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652243.425745:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147732864:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.425766:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652243.425796:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147731584 00000100:00100000:2.0:1788652243.425801:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147731584 00000100:00100000:2.0:1788652243.425833:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788652243.425840:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+24:3635:x1875537147731584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.425876:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+24:3635:x1875537147731584:12345-0@lo:400:kworker.0 Request processed in 37us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652243.425883:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788652243.425936:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147731712 00000100:00100000:2.0:1788652243.425940:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147731712 00000100:00100000:2.0:1788652243.425964:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147732224 00000100:00100000:2.0:1788652243.425967:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147732224 00000100:00100000:2.0:1788652243.425981:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788652243.425988:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147731712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426023:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147731712:12345-0@lo:400:kworker.0 Request processed in 35us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652243.426029:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788652243.426041:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788652243.426048:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147732224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426075:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147732224:12345-0@lo:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652243.426081:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788652243.426101:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147731968 00000100:00100000:2.0:1788652243.426104:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147731968 00000100:00100000:2.0:1788652243.426129:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147732480 00000100:00100000:2.0:1788652243.426133:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147732480 00000100:00100000:2.0:1788652243.426144:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147731840 00000100:00100000:2.0:1788652243.426147:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147731840 00000100:00100000:2.0:1788652243.426159:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147732352 00000100:00100000:2.0:1788652243.426161:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147732352 00000100:00100000:2.0:1788652243.426187:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652243.426193:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147731968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426223:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147731968:12345-0@lo:400:kworker.0 Request processed in 31us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652243.426230:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652243.426241:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788652243.426247:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147732480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426273:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147732480:12345-0@lo:400:kworker.0 Request processed in 27us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652243.426279:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788652243.426289:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788652243.426295:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147731840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426319:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147731840:12345-0@lo:400:kworker.0 Request processed in 25us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652243.426324:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788652243.426334:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788652243.426340:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147732352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426364:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147732352:12345-0@lo:400:kworker.0 Request processed in 25us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652243.426370:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788652243.426419:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147731840:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426430:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147732352:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426439:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147731712:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426448:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147732224:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426485:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147732736 00000100:00100000:2.0:1788652243.426488:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147732736 00000100:00100000:2.0:1788652243.426507:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147732864 00000100:00100000:2.0:1788652243.426510:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147732864 00000100:00100000:2.0:1788652243.426523:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788652243.426529:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147732736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426563:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147732736:12345-0@lo:400:kworker.0 Request processed in 34us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652243.426570:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788652243.426581:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788652243.426588:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147732864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426614:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147732864:12345-0@lo:400:kworker.0 Request processed in 28us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652243.426620:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788652243.426645:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c345b480 x1875537147732864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652243.426655:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147732864:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426667:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147732736:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426692:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f967659c-eb6d-423b-8189-3d2637ee2451:3635:1875537147731584:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426702:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147731968:0@lo:400:kworker.0 00000100:00100000:2.0:1788652243.426712:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147732480:0@lo:400:kworker.0 00000100:00080000:0.0:1788652243.427056:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788652243.427062:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652243.427065:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788652243.427067:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652243.427192:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652243.427204:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147733248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652243.427242:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.427273:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147733248 00000100:00100000:1.0:1788652243.427288:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147733248 00000100:00100000:1.0:1788652243.427319:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788652243.427326:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147733248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788652243.427350:0:24260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788652243.427400:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147733248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.427406:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788652243.427446:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147733248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652243.428225:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788652243.428235:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147733376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788652243.428277:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.428335:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147733376 00000100:00100000:1.0:1788652243.428340:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147733376 00000100:00100000:1.0:1788652243.428376:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788652243.428394:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147733376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788652243.428410:0:24260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788652243.428444:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147733376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.428450:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652243.428527:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147733376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788652243.428641:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147733504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652243.428668:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652243.429173:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147733504 00000100:00100000:3.0:1788652243.429180:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147733504 00000100:00100000:3.0:1788652243.429270:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788652243.429278:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147733504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652243.429300:0:24260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788652243.429658:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147733504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 380us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652243.429665:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788652243.430545:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147733504:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788652243.756193:0:25780:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff32496000 20000000:00000080:1.0:1788652243.756262:0:25780:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f86f6ee4400 uarg=0000000000000000 20000000:01000000:1.0:1788652243.756322:0:25780:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788652243.756327:0:25780:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788652243.756332:0:25780:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788652243.767347:0:25781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:1.0:1788652243.771338:0:25780:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788652243.795625:0:25780:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788652243.796496:0:25780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.796519:0:25780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c585c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5855 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.796527:0:25780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da5e00/0xcd2f56ea038c586a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5863 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.796534:0:25780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c58a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c58a2 expref: 23 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.796539:0:25780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5943 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c593c expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.796549:0:25780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c5b8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3421c expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.796555:0:25780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c5bce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3428c expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.796565:0:25780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.796615:0:25780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c5bce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3428c expref: 12 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.796642:0:25780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c5bce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3428c expref: 12 pid: 22745 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652243.796658:0:25780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da712a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875537147733632:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788652243.796768:0:25780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c5b8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3421c expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.796778:0:25780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c5b8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3421c expref: 12 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652243.796787:0:25780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da710000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875537147733760:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788652243.796815:0:25780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5943 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c593c expref: 23 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.796823:0:25780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5943 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c593c expref: 23 pid: 22745 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652243.796831:0:25780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da710380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875537147733888:0@lo:104: 00000100:00100000:0.0:1788652243.796871:0:25780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652243.796955:0:25780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c58a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c58a2 expref: 23 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.796963:0:25780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c58a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c58a2 expref: 23 pid: 22743 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652243.796972:0:25780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da710a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875537147734016:0@lo:104: 00000100:00100000:0.0:1788652243.796993:0:25780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652243.797024:0:25780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da5e00/0xcd2f56ea038c586a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c5863 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.797032:0:25780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86e7da5e00/0xcd2f56ea038c586a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c5863 expref: 23 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652243.797040:0:25780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da711f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875537147734144:0@lo:104: 00000100:00100000:0.0:1788652243.797060:0:25780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652243.797093:0:25780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c585c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c5855 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652243.797101:0:25780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c585c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c5855 expref: 23 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652243.797110:0:25780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875537147734272:0@lo:104: 00000100:00100000:0.0:1788652243.797140:0:25780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652243.797150:0:25780:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f096b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652243.799962:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147733888 00000100:00100000:1.0:1788652243.799982:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147733888 00000100:00100000:1.0:1788652243.800030:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147734016 00000100:00100000:1.0:1788652243.800034:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147734016 00000100:00100000:1.0:1788652243.800045:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147734144 00000100:00100000:1.0:1788652243.800048:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147734144 00000100:00100000:1.0:1788652243.800056:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147734272 00000100:00100000:1.0:1788652243.800059:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147734272 00000100:00100000:1.0:1788652243.800075:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788652243.800096:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+6:25780:x1875537147733888:12345-0@lo:104: 00010000:00010000:1.0:1788652243.800115:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c5943 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800210:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788652243.800226:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+6:25780:x1875537147733888:12345-0@lo:104: Request processed in 123us (3345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.800233:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788652243.800250:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652243.800256:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+5:25780:x1875537147734016:12345-0@lo:104: 00010000:00010000:1.0:1788652243.800264:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c58a9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800313:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788652243.800319:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+5:25780:x1875537147734016:12345-0@lo:104: Request processed in 64us (3325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.800326:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652243.800338:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652243.800344:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+4:25780:x1875537147734144:12345-0@lo:104: 00010000:00010000:1.0:1788652243.800353:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c586a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800412:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788652243.800418:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da712300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+4:25780:x1875537147734144:12345-0@lo:104: Request processed in 74us (3357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.800424:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652243.800436:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788652243.800441:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+3:25780:x1875537147734272:12345-0@lo:104: 00010000:00010000:1.0:1788652243.800449:0:22733:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c585c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800477:0:22733:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788652243.800481:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f967659c-eb6d-423b-8189-3d2637ee2451+3:25780:x1875537147734272:12345-0@lo:104: Request processed in 41us (3342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.800487:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788652243.800507:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788652243.800512:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c5943 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800520:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652243.800525:0:22738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c5943 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800533:0:22738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c5943 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652243.800540:0:22738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c5943 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652243.800546:0:22738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788652243.800591:0:22738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5943 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800599:0:22738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652243.800618:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5943 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800626:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd600/0xcd2f56ea038c593c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c5943 expref: -99 pid: 25073 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800638:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788652243.800641:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c58a9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800646:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652243.800649:0:22738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c58a9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800656:0:22738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c58a9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652243.800662:0:22738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c58a9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652243.800668:0:22738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788652243.800680:0:22738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c58a9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800685:0:22738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652243.800699:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c58a9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800716:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f85c23dd800/0xcd2f56ea038c58a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c58a9 expref: -99 pid: 24252 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800725:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652243.800728:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c586a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800733:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652243.800736:0:22738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c586a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800742:0:22738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c586a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652243.800748:0:22738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c586a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652243.800753:0:22738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788652243.800767:0:22738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c586a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800772:0:22738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652243.800778:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c586a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800783:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc200/0xcd2f56ea038c5863 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c586a expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800791:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652243.800800:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c585c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800806:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652243.800808:0:22738:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c585c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800814:0:22738:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c585c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652243.800820:0:22738:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c585c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652243.800824:0:22738:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788652243.800837:0:22738:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c585c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800842:0:22738:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652243.800848:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c585c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800854:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c5855 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c585c expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.800869:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652243.800871:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652243.800872:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652243.800893:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147734400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652243.800954:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.800989:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788652243.800995:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147734784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652243.801023:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.801051:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f967659c-eb6d-423b-8189-3d2637ee2451:3637:1875537147734528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652243.801072:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.801086:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652243.801091:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f967659c-eb6d-423b-8189-3d2637ee2451:3637:1875537147734656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652243.801107:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652243.801127:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147734400 00000100:00100000:1.0:1788652243.801132:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147734400 00010000:00010000:1.0:1788652243.801155:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5943 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c593c expref: 24 pid: 22745 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652243.801170:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147734784 00000100:00100000:1.0:1788652243.801173:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147734784 00010000:00010000:1.0:1788652243.801183:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c585c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c5855 expref: 25 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652243.801192:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147734528 00000100:00100000:1.0:1788652243.801194:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147734528 00010000:00010000:1.0:1788652243.801202:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c58a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c58a2 expref: 26 pid: 22743 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652243.801211:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147734656 00000100:00100000:1.0:1788652243.801214:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147734656 00010000:00010000:1.0:1788652243.801223:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da5e00/0xcd2f56ea038c586a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c5863 expref: 27 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652243.801233:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788652243.801239:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+27:3636:x1875537147734400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652243.801249:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652243.801259:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5943 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c593c expref: 27 pid: 22745 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.801269:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5943 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c593c expref: 27 pid: 22745 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.801286:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652243.801314:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+27:3636:x1875537147734400:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.801320:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788652243.801334:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652243.801340:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+26:3636:x1875537147734784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652243.801347:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652243.801351:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c585c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c5855 expref: 26 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.801358:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c585c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c5855 expref: 26 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.801367:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652243.801400:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+26:3636:x1875537147734784:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.801406:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652243.801416:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652243.801421:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+25:3637:x1875537147734528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652243.801428:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652243.801433:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c58a9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c58a2 expref: 25 pid: 22743 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.801452:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c58a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c58a2 expref: 25 pid: 22743 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.801461:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652243.801485:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+25:3637:x1875537147734528:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.801491:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652243.801503:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788652243.801508:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+24:3637:x1875537147734656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652243.801515:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652243.801519:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da5e00/0xcd2f56ea038c586a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c5863 expref: 24 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.801527:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da5e00/0xcd2f56ea038c586a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c5863 expref: 24 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652243.801535:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652243.801553:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f967659c-eb6d-423b-8189-3d2637ee2451+24:3637:x1875537147734656:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652243.801559:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788652243.801591:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f967659c-eb6d-423b-8189-3d2637ee2451:3637:1875537147734656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652243.801599:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f967659c-eb6d-423b-8189-3d2637ee2451:3637:1875537147734528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652243.801625:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147734784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652243.801632:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147734400:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652243.801973:0:25780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1502a00/0xcd2f56ea038c5943 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c593c expref: 23 pid: 22745 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652243.801998:0:25780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da710380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875537147733888:0@lo:104: 00010000:00010000:2.0:1788652243.802011:0:25780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c58a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c58a2 expref: 22 pid: 22743 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652243.802021:0:25780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da710a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875537147734016:0@lo:104: 00010000:00010000:2.0:1788652243.802030:0:25780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5e00/0xcd2f56ea038c586a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c5863 expref: 21 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652243.802037:0:25780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da711f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875537147734144:0@lo:104: 00010000:00010000:2.0:1788652243.802046:0:25780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c585c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c5855 expref: 20 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652243.802053:0:25780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875537147734272:0@lo:104: 00010000:00010000:3.0:1788652243.802583:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652243.802591:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652243.802730:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652243.802767:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652243.802789:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125601536 00000100:00100000:2.0:1788652243.802796:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125601536 00010000:00010000:2.0:1788652243.802822:0:22736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c5bce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3428c expref: 13 pid: 22745 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652243.802843:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125601664 00000100:00100000:2.0:1788652243.802846:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125601664 00010000:00010000:2.0:1788652243.802857:0:22736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c5b8f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3421c expref: 14 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652243.802871:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:2.0:1788652243.802878:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f4adb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+14:2389:x1875537125601536:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652243.802899:0:22736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652243.802904:0:22736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c5bce lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3428c expref: 14 pid: 22745 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.802945:0:22736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c5bce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3428c expref: 14 pid: 22745 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.802961:0:22736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652243.803005:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f4adb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+14:2389:x1875537125601536:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 127us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652243.803013:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:2.0:1788652243.803050:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:2.0:1788652243.803057:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:2388:x1875537125601664:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652243.803065:0:22736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652243.803069:0:22736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c5b8f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3421c expref: 13 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.803078:0:22736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c5b8f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3421c expref: 13 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.803103:0:22736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.803112:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.803128:0:22736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.803147:0:22736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.803154:0:22736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.803161:0:22736:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.803167:0:22736:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652243.803172:0:22736:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.803181:0:22736:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.803190:0:22736:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652243.803201:0:22736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652243.803416:0:25780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c5bce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3428c expref: 13 pid: 22745 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652243.803429:0:25780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da712a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875537147733632:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788652243.803440:0:25780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c5b8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3421c expref: 12 pid: 22744 timeout: 799 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652243.803448:0:25780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da710000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25780:1875537147733760:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788652243.803480:0:25780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652243.803489:0:25780:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652243.803496:0:25780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652243.803502:0:25780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f4b96600/0xcd2f56ea038c5bff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652243.805035:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:2388:x1875537125601664:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 1971us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652243.805048:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 14 00010000:00010000:1.0:1788652244.384053:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788652244.833011:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788652244.839753:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652244.839843:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125601792 00000100:00100000:0.0:1788652244.839854:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125601792 00000100:00100000:0.0:1788652244.839944:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 146 00000100:00100000:0.0:1788652244.839956:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+11:18147:x1875537125601792:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652244.839975:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652244.839996:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c5c06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe342c4 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652244.840026:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c5c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342c4 expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652244.840039:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c5c06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342c4 expref: 12 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652244.840071:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97600, rc 0) 00000100:00100000:0.0:1788652244.840136:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+12:18147:x1875537125601792:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 Request processed in 183us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652244.840143:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 146 00000100:00100000:2.0:1788652244.855002:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652244.855166:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125601920 00000100:00100000:0.0:1788652244.855188:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125601920 00000100:00100000:0.0:1788652244.855255:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 147 00000100:00100000:0.0:1788652244.855265:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+12:18147:x1875537125601920:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652244.855452:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+12:18147:x1875537125601920:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 Request processed in 187us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652244.855461:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 147 00000100:00100000:3.0:1788652244.866627:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652244.869043:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125602048 00000100:00100000:2.0:1788652244.869060:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125602048 00000100:00100000:2.0:1788652244.869184:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 148 00000100:00100000:2.0:1788652244.869213:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+12:18147:x1875537125602048:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652244.869375:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+12:18147:x1875537125602048:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 Request processed in 164us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652244.869383:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 148 00000100:00100000:3.0:1788652244.877068:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652244.877379:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125602176 00000100:00100000:2.0:1788652244.877391:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125602176 00000100:00100000:2.0:1788652244.877450:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 149 00000100:00100000:2.0:1788652244.877460:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+12:18147:x1875537125602176:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652244.877477:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652244.877498:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dc400/0xcd2f56ea038c5c0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe342cb expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652244.877528:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dc400/0xcd2f56ea038c5c0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342cb expref: 13 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652244.877541:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dc400/0xcd2f56ea038c5c0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342cb expref: 13 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652244.877551:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc400, rc 0) 00000100:00100000:2.0:1788652244.877638:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18147:x1875537125602176:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 Request processed in 180us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652244.877643:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 149 00000100:00100000:3.0:1788652244.879249:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652244.879363:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125602304 00000100:00100000:2.0:1788652244.879374:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125602304 00000100:00100000:2.0:1788652244.879426:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 150 00000100:00100000:2.0:1788652244.879435:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18147:x1875537125602304:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652244.879624:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18147:x1875537125602304:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 Request processed in 190us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652244.879632:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 150 00000100:00100000:3.0:1788652244.881191:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652244.881289:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125602432 00000100:00100000:2.0:1788652244.881298:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125602432 00000100:00100000:2.0:1788652244.881352:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 151 00000100:00100000:2.0:1788652244.881371:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18147:x1875537125602432:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652244.881492:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:18147:x1875537125602432:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 Request processed in 122us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652244.881500:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 151 00000100:00100000:3.0:1788652245.000142:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652245.000502:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125602560 00000100:00100000:2.0:1788652245.000515:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125602560 00000100:00100000:2.0:1788652245.000580:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:2.0:1788652245.000589:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:18768:x1875537125602560:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652245.000620:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652245.000643:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe342d2 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.000967:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.000985:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.000999:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001032:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001039:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001047:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001124:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c5c29 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001138:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c5c29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001144:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c5c29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652245.001172:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788652245.001175:0:22752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788652245.001211:0:22752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c5c29 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001222:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001228:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001234:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001248:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652245.001252:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001260:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001274:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374f00) 00010000:00010000:2.0:1788652245.001277:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652245.001281:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001287:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001300:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001306:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001312:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001317:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652245.001320:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001326:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001344:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f86c3228b00) 00010000:00010000:2.0:1788652245.001346:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652245.001349:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001365:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001400:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342d2 expref: 8 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001414:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c5c29 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342d2 expref: 7 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.001421:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f86c3228300) 00010000:00010000:2.0:1788652245.001423:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652245.001425:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd600, rc 0) 00000100:00100000:2.0:1788652245.001969:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:18768:x1875537125602560:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 1378us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652245.001977:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:3.0:1788652245.006741:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.007093:0:22761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125602688 00000100:00100000:0.0:1788652245.007105:0:22761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125602688 00000100:00100000:0.0:1788652245.007280:0:22761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:0.0:1788652245.007293:0:22761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:18768:x1875537125602688:12345-192.168.204.45@tcp:900:lhsmtool_posix.0 00000100:00080000:2.0:1788652245.007421:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652245.007471:0:22761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:18768:x1875537125602688:12345-192.168.204.45@tcp:900:lhsmtool_posix.0 Request processed in 181us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.007483:0:22761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:3.0:1788652245.012592:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.012683:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125602944 00000100:00100000:0.0:1788652245.012696:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125602944 00000100:00100000:0.0:1788652245.012882:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:0.0:1788652245.012894:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:18768:x1875537125602944:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652245.013000:0:23985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652245.013370:0:23985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c5c30 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe342d9 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013486:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c37 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013502:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013514:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013528:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c3e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013534:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013541:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013650:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c5c45 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013657:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c5c45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013663:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c5c45 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652245.013684:0:23985:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788652245.013858:0:23985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013876:0:23985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c37 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013883:0:23985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013889:0:23985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652245.013932:0:23985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013951:0:23985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c37 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013965:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f86c3228300) 00010000:00010000:0.0:1788652245.013969:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652245.013973:0:23985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013979:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013993:0:23985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.013998:0:23985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c3e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.014004:0:23985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.014008:0:23985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652245.014017:0:23985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.014024:0:23985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c3e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.014032:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f85c2857500) 00010000:00010000:0.0:1788652245.014034:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652245.014037:0:23985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c3e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.014043:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c3e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.018121:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c5c30 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342d9 expref: 10 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.018613:0:23985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c5c45 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342d9 expref: 9 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.018625:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f85c2857a00) 00010000:00010000:0.0:1788652245.018627:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652245.018630:0:23985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97e00, rc 0) 00000100:00100000:0.0:1788652245.018784:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+9:18768:x1875537125602944:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 5891us (6198us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788652245.018794:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:2.0:1788652245.025743:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652245.026046:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125603072 00000100:00100000:1.0:1788652245.026066:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125603072 00000100:00100000:1.0:1788652245.026230:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:1.0:1788652245.026242:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+9:18768:x1875537125603072:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788652245.026381:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+9:18768:x1875537125603072:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 Request processed in 140us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652245.026389:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:3.0:1788652245.052890:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652245.053657:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125603200 00000100:00100000:2.0:1788652245.053763:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125603200 00000100:00080000:0.0:1788652245.054172:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788652245.054426:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:1.0:1788652245.054441:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:18768:x1875537125603200:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788652245.059734:0:23985:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5244us 00000100:00100000:2.0:1788652245.063191:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.063311:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125603328 00000100:00100000:0.0:1788652245.063331:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125603328 00000100:00100000:0.0:1788652245.063513:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 27 00000100:00100000:0.0:1788652245.063525:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+9:18774:x1875537125603328:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788652245.063547:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652245.063569:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c5c53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe342e0 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063641:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063659:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063673:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063759:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063767:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063775:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063830:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063838:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c5a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063844:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063856:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652245.063861:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063870:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063883:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374f00) 00010000:00010000:0.0:1788652245.063887:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652245.063892:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063899:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c5c5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063938:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063945:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063951:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063956:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652245.063959:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063965:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063983:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8f85c2857500) 00010000:00010000:0.0:1788652245.063985:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652245.063989:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.063995:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c5c61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.064029:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c5c53 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342e0 expref: 10 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.064039:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374f00) 00010000:00010000:0.0:1788652245.064042:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652245.064046:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c5c53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342e0 expref: 10 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.064055:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96400, rc 0) 00000100:00100000:0.0:1788652245.064428:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+9:18774:x1875537125603328:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 903us (1245us total) trans 0 rc 301/301 00000100:00100000:0.0:1788652245.064436:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 27 00000100:00100000:3.0:1788652245.076710:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:18768:x1875537125603200:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 Request processed in 22261us (23819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652245.076725:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:3.0:1788652245.076811:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.076858:0:22759:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125603456 00000100:00100000:0.0:1788652245.076868:0:22759:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125603456 00000100:00100000:3.0:1788652245.076973:0:22760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:3.0:1788652245.076984:0:22760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+9:18774:x1875537125603456:12345-192.168.204.45@tcp:700:lfs.0 00000100:00100000:3.0:1788652245.077040:0:22760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+9:18774:x1875537125603456:12345-192.168.204.45@tcp:700:lfs.0 Request processed in 58us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652245.077047:0:22760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:3.0:1788652245.082131:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652245.082211:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125603712 00000100:00100000:2.0:1788652245.082223:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125603712 00000100:00100000:2.0:1788652245.082294:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:2.0:1788652245.082320:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+9:18774:x1875537125603712:12345-192.168.204.45@tcp:36:lfs.0 00010000:00010000:2.0:1788652245.082388:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652245.082419:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5bb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3424d expref: 9 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.082437:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374f00) 00010000:00010000:2.0:1788652245.082443:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652245.082504:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.082518:0:22751:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5bf8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342bd expref: 5 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.082527:0:22751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.082578:0:22751:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342bd expref: 5 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.082594:0:22751:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342bd expref: 5 pid: 22751 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652245.082610:0:22751:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22751:1875537147734912:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788652245.082706:0:22751:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952840 going to sleep for 11 seconds 00000100:00100000:3.0:1788652245.087874:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.088124:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125603840 00000100:00100000:0.0:1788652245.088136:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125603840 00010000:00010000:0.0:1788652245.088217:0:24282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5bf8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342bd expref: 6 pid: 22751 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788652245.088347:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652245.088379:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:0.0:1788652245.088406:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:2388:x1875537125603840:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788652245.088423:0:24282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652245.088432:0:24282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5bf8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342bd expref: 6 pid: 22751 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.088447:0:24282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5bf8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342bd expref: 6 pid: 22751 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.088470:0:24282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374f00) 00010000:00010000:0.0:1788652245.088476:0:24282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.088488:0:24282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.088497:0:24282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.088520:0:24282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788652245.088632:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:2388:x1875537125603840:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 228us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.088641:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 15 00010000:00010000:2.0:1788652245.091747:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5bf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342bd expref: 5 pid: 22751 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652245.091780:0:22751:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22751:1875537147734912:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788652245.091825:0:22751:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.091836:0:22751:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.091843:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.091874:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c6f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.091890:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.091902:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094421:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c76 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094448:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094465:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652245.094485:0:22751:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039cffd08 reply state 00000000b4d4bf69 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094497:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c76 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094516:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788652245.094519:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788652245.094524:0:22751:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788652245.094531:0:22751:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788652245.094540:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094548:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094624:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094632:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dce00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652245.094638:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094646:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094658:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374f00) 00010000:00010000:2.0:1788652245.094661:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652245.094665:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094672:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dce00/0xcd2f56ea038c5c68 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788652245.094694:0:22751:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000039cffd08 reply state 00000000b4d4bf69 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c6f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094714:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.094720:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8f86c3228b00) 00010000:00010000:2.0:1788652245.094722:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788652245.094725:0:22751:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788652245.094820:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+10:18774:x1875537125603712:12345-192.168.204.45@tcp:36:lfs.0 Request processed in 12499us (12693us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788652245.094829:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 28 10000000:01000000:1.0:1788652245.152078:0:22748:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788652245.152087:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f85c3727800 from 13 10000000:01000000:1.0:1788652245.152093:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788652245.153056:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c5c7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.153072:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c5c7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.153085:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c5c7d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652245.153116:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788652245.153464:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652245.153516:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0480 going to sleep for 11 seconds 00000100:00100000:0.0:1788652245.153983:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147735040 00000100:00100000:0.0:1788652245.153993:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147735040 00000100:00100000:0.0:1788652245.154060:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788652245.154072:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c2b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+20:22748:x1875537147735040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652245.154088:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652245.154103:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b96400/0xcd2f56ea038c5c84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5c7d expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.154145:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b96400/0xcd2f56ea038c5c84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5c7d expref: 21 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.154158:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b96400/0xcd2f56ea038c5c84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5c7d expref: 21 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.154168:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96400, rc 0) 00000100:00100000:0.0:1788652245.154233:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c2b5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+21:22748:x1875537147735040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.154240:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788652245.154324:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652245.154343:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c5c7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5c84 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.154365:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c5c7d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5c84 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652245.154444:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652245.154491:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652245.154526:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788652245.154711:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147735168 00000100:00100000:0.0:1788652245.154716:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147735168 00000100:00100000:0.0:1788652245.154752:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788652245.154759:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:22748:x1875537147735168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652245.154874:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:22748:x1875537147735168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.154882:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788652245.155078:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652245.155109:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da711f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652245.155150:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652245.155185:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c11cad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652245.155386:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147735296 00000100:00100000:0.0:1788652245.155390:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147735296 00000100:00100000:0.0:1788652245.155433:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788652245.155440:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:22748:x1875537147735296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652245.155524:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:22748:x1875537147735296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.155531:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788652245.155784:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da711f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788652245.157538:0:25794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788652245.157807:0:22748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788652245.157837:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788652245.157861:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c5c7d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5c84 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.157873:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c5c7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5c84 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652245.157883:0:22748:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788652245.157886:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86dfa34000 from 13 10000000:01000000:3.0:1788652245.157889:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788652245.157950:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7400/0xcd2f56ea038c5c8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.157958:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7400/0xcd2f56ea038c5c8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.157970:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7400/0xcd2f56ea038c5c8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652245.157992:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da711f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788652245.158051:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652245.158088:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788652245.158150:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147735424 00000100:00100000:0.0:1788652245.158157:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147735424 00000100:00100000:0.0:1788652245.158223:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788652245.158232:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+21:22748:x1875537147735424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652245.158245:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652245.158258:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b96800/0xcd2f56ea038c5c92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5c8b expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.158279:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b96800/0xcd2f56ea038c5c92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5c8b expref: 22 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.158291:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b96800/0xcd2f56ea038c5c92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5c8b expref: 22 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.158299:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96800, rc 0) 00000100:00100000:0.0:1788652245.158344:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+22:22748:x1875537147735424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.158363:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788652245.158589:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da711f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652245.158603:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7400/0xcd2f56ea038c5c8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5c92 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.158623:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7400/0xcd2f56ea038c5c8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5c92 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652245.158680:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da711f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652245.158713:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652245.158734:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788652245.159538:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147735552 00000100:00100000:1.0:1788652245.159545:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147735552 00000100:00100000:1.0:1788652245.159595:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788652245.159602:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+22:22748:x1875537147735552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652245.159778:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+22:22748:x1875537147735552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 176us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652245.159786:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788652245.161784:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da711f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652245.161851:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652245.161979:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652245.162071:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952300 going to sleep for 11 seconds 00000100:00100000:0.0:1788652245.162560:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147735680 00000100:00100000:0.0:1788652245.162568:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147735680 00000100:00100000:0.0:1788652245.162658:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788652245.162668:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+22:22748:x1875537147735680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652245.162825:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+22:22748:x1875537147735680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.162833:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788652245.168342:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788652245.170601:0:25795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788652245.170882:0:22748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788652245.170958:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788652245.170971:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7400/0xcd2f56ea038c5c8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5c92 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.170982:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7400/0xcd2f56ea038c5c8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5c92 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652245.170993:0:22748:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788652245.170996:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86c92db800 from 13 10000000:01000000:2.0:1788652245.170999:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652245.171043:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dce00/0xcd2f56ea038c5c99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.171052:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c23dce00/0xcd2f56ea038c5c99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.171063:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c23dce00/0xcd2f56ea038c5c99 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652245.171087:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652245.171153:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652245.171277:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147735808 00000100:00100000:1.0:1788652245.171285:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147735808 00000100:00100000:1.0:1788652245.171333:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788652245.171344:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+22:22748:x1875537147735808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652245.171369:0:22744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652245.171383:0:22744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5ca0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5c99 expref: -99 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.171408:0:22744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5c99 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.171419:0:22744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c5ca0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5c99 expref: 23 pid: 22744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.171440:0:22744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414000, rc 0) 00000100:00100000:1.0:1788652245.173960:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+23:22748:x1875537147735808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2610us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652245.173971:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788652245.174485:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952300 going to sleep for 11 seconds 00000100:00100000:2.0:1788652245.174514:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652245.174539:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c23dce00/0xcd2f56ea038c5c99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5ca0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.174551:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dce00/0xcd2f56ea038c5c99 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5ca0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652245.174633:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652245.174686:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652245.174745:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952300 going to sleep for 11 seconds 00000100:00100000:3.0:1788652245.180121:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147735936 00000100:00100000:3.0:1788652245.180139:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147735936 00000100:00100000:3.0:1788652245.180207:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788652245.180218:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d09bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+23:22748:x1875537147735936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652245.180410:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d09bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+23:22748:x1875537147735936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 193us (5723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652245.180418:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788652245.180584:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147735936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652245.180650:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147736064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652245.180704:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652245.180745:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952300 going to sleep for 11 seconds 00000100:00100000:0.0:1788652245.180815:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147736064 00000100:00100000:0.0:1788652245.180819:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147736064 00000100:00100000:0.0:1788652245.180855:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788652245.180862:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+23:22748:x1875537147736064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652245.180970:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3262850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+23:22748:x1875537147736064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.180984:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788652245.181070:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147736064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788652245.182163:0:25796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788652245.191593:0:22748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788652245.191883:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788652245.191897:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dce00/0xcd2f56ea038c5c99 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5ca0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.192093:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c23dce00/0xcd2f56ea038c5c99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5ca0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652245.192105:0:22748:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788652245.192108:0:22748:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86f3c9f800 from 13 10000000:01000000:2.0:1788652245.192112:0:22748:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652245.192163:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c5ca7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.192272:0:22748:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c5ca7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.192284:0:22748:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c5ca7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652245.192314:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147736192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652245.192413:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652245.192507:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952300 going to sleep for 11 seconds 00000100:00100000:0.0:1788652245.193880:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147736192 00000100:00100000:0.0:1788652245.193894:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147736192 00000100:00100000:0.0:1788652245.194130:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788652245.194143:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+23:22748:x1875537147736192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652245.194162:0:22745:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652245.194180:0:22745:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b96c00/0xcd2f56ea038c5cae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5ca7 expref: -99 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.194210:0:22745:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b96c00/0xcd2f56ea038c5cae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5ca7 expref: 24 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.194232:0:22745:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b96c00/0xcd2f56ea038c5cae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5ca7 expref: 24 pid: 22745 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.194242:0:22745:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96c00, rc 0) 00000100:00100000:0.0:1788652245.194323:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3261850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+24:22748:x1875537147736192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.194330:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788652245.194448:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147736192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652245.194469:0:22748:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c5ca7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5cae expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.194480:0:22748:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c5ca7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5cae expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652245.194563:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da710a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147736320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652245.194598:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652245.194623:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147736320 00000100:00100000:0.0:1788652245.194628:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147736320 00000100:00100000:3.0:1788652245.194633:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788652245.194702:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788652245.194710:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+24:22748:x1875537147736320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652245.194830:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3263450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f967659c-eb6d-423b-8189-3d2637ee2451+24:22748:x1875537147736320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.194838:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788652245.194896:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da710a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147736320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652245.194953:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86da710a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147736448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652245.195067:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652245.195089:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788652245.195113:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147736448 00000100:00100000:2.0:1788652245.195119:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147736448 00000100:00100000:2.0:1788652245.195266:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788652245.195276:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+24:22748:x1875537147736448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788652245.195389:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3261c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f967659c-eb6d-423b-8189-3d2637ee2451+24:22748:x1875537147736448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652245.195396:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788652245.195464:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86da710a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f967659c-eb6d-423b-8189-3d2637ee2451:22748:1875537147736448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788652245.198664:0:25797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788652245.198892:0:22748:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788652245.198942:0:22748:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788652245.198954:0:22748:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c5ca7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5cae expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.198965:0:22748:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c5ca7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5cae expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652245.219094:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.219180:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125603968 00000100:00100000:0.0:1788652245.219206:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125603968 00000100:00100000:0.0:1788652245.219279:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:0.0:1788652245.219290:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+10:18782:x1875537125603968:12345-192.168.204.45@tcp:101:lctl.0 00010000:00010000:0.0:1788652245.219320:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652245.219345:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe342e7 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.219438:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c5cbc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.219454:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c5cbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.219467:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c5cbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652245.219511:0:22750:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788652245.219515:0:22750:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788652245.219553:0:22750:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c5cbc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.219579:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342e7 expref: 12 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.219595:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c5cbc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342e7 expref: 11 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.219603:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:0.0:1788652245.219607:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788652245.219610:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96200, rc 0) 00000100:00100000:0.0:1788652245.219679:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+11:18782:x1875537125603968:12345-192.168.204.45@tcp:101:lctl.0 Request processed in 391us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.219687:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:3.0:1788652245.259672:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652245.259746:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125604096 00000100:00100000:1.0:1788652245.259756:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125604096 00000100:00100000:1.0:1788652245.259894:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 30 00000100:00100000:1.0:1788652245.259904:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:18783:x1875537125604096:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:1.0:1788652245.259972:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652245.259994:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5cc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe342ee expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.260062:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415600/0xcd2f56ea038c5cca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.260078:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415600/0xcd2f56ea038c5cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.260090:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415600/0xcd2f56ea038c5cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652245.260137:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788652245.260141:0:22752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788652245.260161:0:22752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415600/0xcd2f56ea038c5cca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.260186:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5cc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342ee expref: 7 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.260205:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415600/0xcd2f56ea038c5cca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342ee expref: 6 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.260214:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:1.0:1788652245.260217:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652245.260221:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415600, rc 0) 00000100:00100000:1.0:1788652245.260414:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:18783:x1875537125604096:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 510us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652245.260422:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 30 00000100:00100000:3.0:1788652245.263452:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652245.263690:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125604224 00000100:00100000:1.0:1788652245.263701:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125604224 00000100:00100000:1.0:1788652245.263756:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 31 00000100:00100000:1.0:1788652245.263777:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:18783:x1875537125604224:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:1.0:1788652245.263798:0:23985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652245.263817:0:23985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414400/0xcd2f56ea038c5cd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe342f5 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.263886:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5cd8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.263901:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5cd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.263943:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5cd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.263956:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5cdf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.263969:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5cdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.263976:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5cdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264059:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5ce6 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264068:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5ce6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264092:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5ce6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652245.264131:0:23985:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788652245.264135:0:23985:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788652245.264167:0:23985:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5ce6 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264181:0:23985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5cd8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264187:0:23985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5cd8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264422:0:23985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5cd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264430:0:23985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652245.264435:0:23985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5cd8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264444:0:23985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5cd8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264457:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:1.0:1788652245.264461:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652245.264466:0:23985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5cd8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264473:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5cd8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264499:0:23985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5cdf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264505:0:23985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5cdf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264511:0:23985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5cdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264516:0:23985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652245.264519:0:23985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5cdf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264525:0:23985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5cdf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264533:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8f86c3228b00) 00010000:00010000:1.0:1788652245.264536:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652245.264539:0:23985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5cdf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264545:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5cdf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264572:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414400/0xcd2f56ea038c5cd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342f5 expref: 8 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264586:0:23985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5ce6 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342f5 expref: 7 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.264605:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:1.0:1788652245.264607:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652245.264610:0:23985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414600, rc 0) 00000100:00100000:1.0:1788652245.264773:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfcf836d-8d6b-40c7-adfd-767bab831a9a+7:18783:x1875537125604224:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 1007us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652245.264781:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 31 00000100:00100000:3.0:1788652245.268819:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652245.269007:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125604352 00000100:00100000:1.0:1788652245.269018:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125604352 00000100:00080000:0.0:1788652245.269075:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788652245.269088:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:1.0:1788652245.269099:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:18783:x1875537125604352:12345-192.168.204.45@tcp:900:lfs.0 00000100:00100000:1.0:1788652245.269242:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:18783:x1875537125604352:12345-192.168.204.45@tcp:900:lfs.0 Request processed in 144us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652245.269249:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:3.0:1788652245.272651:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652245.272880:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125604608 00000100:00100000:2.0:1788652245.272891:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125604608 00000100:00100000:2.0:1788652245.272983:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 32 00000100:00100000:2.0:1788652245.272994:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+7:18783:x1875537125604608:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788652245.273015:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652245.273036:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c5ced lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe342fc expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652245.273137:0:22751:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788652245.273317:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c5ced lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342fc expref: 9 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.273361:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:2.0:1788652245.273365:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788652245.273371:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c5ced lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342fc expref: 9 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.273384:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd000, rc 0) 00000100:00100000:2.0:1788652245.273447:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+8:18783:x1875537125604608:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 455us (809us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788652245.273454:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 32 00000100:00100000:2.0:1788652245.277812:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.278133:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125604864 00000100:00100000:0.0:1788652245.278144:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125604864 00000100:00100000:0.0:1788652245.278402:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:0.0:1788652245.278413:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfcf836d-8d6b-40c7-adfd-767bab831a9a+8:18783:x1875537125604864:12345-192.168.204.45@tcp:36:lfs.0 00010000:00010000:0.0:1788652245.278468:0:22750:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652245.278495:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5ce6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe342f5 expref: 8 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.278516:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788652245.278521:0:22750:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652245.278544:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cfb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.278568:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cfb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.278580:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cfb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788652245.278800:0:22750:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b1ee60f reply state 0000000041c55000 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cfb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.278814:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cfb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.278820:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788652245.278829:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788652245.278833:0:22750:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788652245.278840:0:22750:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788652245.278941:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bfcf836d-8d6b-40c7-adfd-767bab831a9a+9:18783:x1875537125604864:12345-192.168.204.45@tcp:36:lfs.0 Request processed in 530us (1139us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788652245.278949:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:2.0:1788652245.282029:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652245.282128:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125605120 00000100:00100000:3.0:1788652245.282139:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125605120 00000100:00100000:3.0:1788652245.282218:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:3.0:1788652245.282229:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+9:18783:x1875537125605120:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:3.0:1788652245.282472:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+10:18783:x1875537125605120:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 244us (463us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788652245.282480:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:3.0:1788652245.286878:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.287421:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125605376 00000100:00100000:0.0:1788652245.287433:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125605376 00000100:00100000:0.0:1788652245.287500:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 34 00000100:00100000:0.0:1788652245.287511:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+10:18783:x1875537125605376:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788652245.287536:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652245.287570:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5d02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34303 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.287655:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d09 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.287685:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.287698:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.287708:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d10 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.287715:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.287721:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652245.287853:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788652245.287950:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d09 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.287958:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d09 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.287964:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.287970:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652245.287974:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d09 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.287982:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d09 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.287996:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:0.0:1788652245.287999:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652245.288004:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.288010:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.288037:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d10 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.288042:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d10 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.288057:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.288064:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652245.288066:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d10 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.288073:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d10 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.288082:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8f86c3228b00) 00010000:00010000:0.0:1788652245.288084:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652245.288087:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d10 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.288093:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d10 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.288126:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5d02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34303 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.288136:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:0.0:1788652245.288139:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652245.288142:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5d02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34303 expref: 12 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.288152:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97400, rc 0) 00000100:00100000:0.0:1788652245.289837:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+11:18783:x1875537125605376:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 2317us (2960us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788652245.289862:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 34 00000100:00100000:2.0:1788652245.294245:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652245.296745:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125605504 00000100:00100000:1.0:1788652245.296761:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125605504 00000100:00100000:1.0:1788652245.296846:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 35 00000100:00100000:1.0:1788652245.296856:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfcf836d-8d6b-40c7-adfd-767bab831a9a+11:18783:x1875537125605504:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:1.0:1788652245.296881:0:23985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652245.296903:0:23985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414400/0xcd2f56ea038c5d1e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3430a expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.297134:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5d25 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.297150:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5d25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.297196:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5d25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652245.297225:0:23985:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788652245.297229:0:23985:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788652245.297249:0:23985:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5d25 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.297275:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414400/0xcd2f56ea038c5d1e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3430a expref: 13 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.297304:0:23985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5d25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3430a expref: 12 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.297313:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:1.0:1788652245.297316:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652245.297320:0:23985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414e00, rc 0) 00000100:00100000:1.0:1788652245.297405:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:bfcf836d-8d6b-40c7-adfd-767bab831a9a+12:18783:x1875537125605504:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 551us (3173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652245.297412:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 35 00000100:00100000:2.0:1788652245.307766:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652245.307873:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125605632 00000100:00100000:3.0:1788652245.307884:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125605632 00000100:00100000:3.0:1788652245.308044:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:3.0:1788652245.308054:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+12:18783:x1875537125605632:12345-192.168.204.45@tcp:37:lfs.0 00000100:00100000:0.0:1788652245.313840:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+12:18783:x1875537125605632:12345-192.168.204.45@tcp:37:lfs.0 Request processed in 5770us (6066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.313857:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:2.0:1788652245.318044:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.318454:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125605888 00000100:00100000:0.0:1788652245.318469:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125605888 00000100:00100000:0.0:1788652245.318537:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:0.0:1788652245.318546:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d25ebc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfcf836d-8d6b-40c7-adfd-767bab831a9a+12:18783:x1875537125605888:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:0.0:1788652245.319044:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d25ebc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bfcf836d-8d6b-40c7-adfd-767bab831a9a+13:18783:x1875537125605888:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 497us (1008us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788652245.319053:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:2.0:1788652245.373201:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.373312:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125606016 00000100:00100000:0.0:1788652245.373324:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125606016 00000100:00100000:0.0:1788652245.373401:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 36 00000100:00100000:0.0:1788652245.373413:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+11:18789:x1875537125606016:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788652245.373435:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652245.373458:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5d2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34311 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.373636:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.373651:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.373663:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.373761:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.373770:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.373778:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.373855:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c5d41 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.373865:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c5d41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.373872:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c5d41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652245.373905:0:22751:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788652245.374591:0:22751:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788652245.374733:0:22751:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c5d41 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374747:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374754:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d33 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374762:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374768:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652245.374781:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374790:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374805:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:2.0:1788652245.374809:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652245.374814:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374826:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5d33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374842:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374848:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374854:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374859:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652245.374863:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374872:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374880:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8f86c3228b00) 00010000:00010000:2.0:1788652245.374883:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652245.374893:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.374899:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5d3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.375445:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5d2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34311 expref: 13 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.375463:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c5d41 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34311 expref: 12 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.375471:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788652245.375474:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788652245.375476:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96a00, rc 0) 00000100:00100000:2.0:1788652245.376134:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+12:18789:x1875537125606016:12345-192.168.204.45@tcp:101:bash.0 Request processed in 2718us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652245.376144:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 36 00000100:00100000:3.0:1788652245.378457:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652245.378724:0:22762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125606144 00000100:00100000:1.0:1788652245.378736:0:22762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125606144 00000100:00100000:1.0:1788652245.378796:0:22762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:1.0:1788652245.378806:0:22762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:18789:x1875537125606144:12345-192.168.204.45@tcp:900:bash.0 00000100:00100000:1.0:1788652245.378896:0:22762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:18789:x1875537125606144:12345-192.168.204.45@tcp:900:bash.0 Request processed in 91us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652245.378904:0:22762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:3.0:1788652245.381112:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652245.381223:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125606400 00000100:00100000:1.0:1788652245.381243:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125606400 00000100:00100000:1.0:1788652245.381473:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 37 00000100:00100000:1.0:1788652245.381485:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+12:18789:x1875537125606400:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:1.0:1788652245.381507:0:23985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652245.381529:0:23985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414400/0xcd2f56ea038c5d48 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34318 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.381660:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.381677:0:23985:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5d25 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3430a expref: 12 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.381688:0:23985:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.382604:0:23985:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5d25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3430a expref: 12 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.382622:0:23985:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5d25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3430a expref: 12 pid: 23985 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652245.382638:0:23985:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23985:1875537147736576:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788652245.382747:0:23985:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652245.386698:0:23985:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23985:1875537147736576:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788652245.386729:0:23985:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652245.387874:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652245.388145:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125606528 00000100:00100000:2.0:1788652245.388166:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125606528 00010000:00010000:2.0:1788652245.388209:0:22736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5d25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3430a expref: 13 pid: 23985 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652245.388256:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:2.0:1788652245.388266:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+13:2388:x1875537125606528:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652245.388282:0:22736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652245.388289:0:22736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5d25 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3430a expref: 13 pid: 23985 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.388318:0:22736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5d25 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3430a expref: 13 pid: 23985 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.388342:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c5d25 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3430a expref: 13 pid: 23985 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.388372:0:22736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788652245.388378:0:22736:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.388389:0:22736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.388398:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.388432:0:22736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652245.388561:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfcf836d-8d6b-40c7-adfd-767bab831a9a+12:2388:x1875537125606528:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 295us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652245.388570:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 16 00010000:00010000:3.0:1788652245.388627:0:23985:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.388639:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.388720:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c5d56 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.388737:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c5d56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.388748:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c5d56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.389368:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5d5d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.389379:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5d5d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.389386:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5d5d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652245.390026:0:23985:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788652245.390544:0:23985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.390555:0:23985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.390562:0:23985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.390567:0:23985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788652245.390572:0:23985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.390581:0:23985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.390657:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:3.0:1788652245.390660:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652245.390666:0:23985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.390673:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415400/0xcd2f56ea038c5d4f lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788652245.390687:0:23985:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016f30633 reply state 00000000fdf0a3cd transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c5d56 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.390697:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c5d56 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.390704:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8f86c3a1b100) 00010000:00010000:3.0:1788652245.390706:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788652245.390709:0:23985:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788652245.390749:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414400/0xcd2f56ea038c5d48 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34318 expref: 15 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.390764:0:23985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5d5d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34318 expref: 14 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.390771:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:3.0:1788652245.390773:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788652245.390775:0:23985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6800, rc 0) 00000100:00100000:3.0:1788652245.390844:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+15:18789:x1875537125606400:12345-192.168.204.45@tcp:101:bash.0 Request processed in 9361us (9737us total) trans 12884901896 rc 0/0 00000100:00100000:3.0:1788652245.390852:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 37 00000100:00100000:3.0:1788652245.407786:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652245.408220:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125606656 00000100:00100000:2.0:1788652245.408233:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125606656 00000100:00100000:2.0:1788652245.408294:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 38 00000100:00100000:2.0:1788652245.408306:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+15:18789:x1875537125606656:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788652245.408411:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652245.408432:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5d6b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3431f expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.408488:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652245.408528:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.408545:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.408558:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652245.408610:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788652245.408614:0:22752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788652245.408632:0:22752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.408642:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.408730:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5d6b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3431f expref: 17 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.408750:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3431f expref: 16 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.408760:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:2.0:1788652245.408762:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652245.408766:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86fc58e200, rc 0) 00000100:00100000:2.0:1788652245.408833:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+16:18789:x1875537125606656:12345-192.168.204.45@tcp:101:bash.0 Request processed in 529us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652245.408840:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 38 00000100:00100000:3.0:1788652245.411460:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.411607:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125606912 00000100:00100000:0.0:1788652245.411618:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125606912 00000100:00100000:0.0:1788652245.411772:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:0.0:1788652245.411784:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+16:18789:x1875537125606912:12345-192.168.204.45@tcp:35:bash.0 00000100:00100000:0.0:1788652245.412198:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+17:18789:x1875537125606912:12345-192.168.204.45@tcp:35:bash.0 Request processed in 416us (748us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788652245.412206:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:0.0:1788652245.487623:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652245.487797:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125607168 00000100:00100000:2.0:1788652245.487808:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125607168 00000100:00100000:2.0:1788652245.487868:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 39 00000100:00100000:2.0:1788652245.487880:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+17:18799:x1875537125607168:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788652245.487940:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652245.487973:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5d79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34326 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652245.488089:0:22750:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788652245.488761:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5d79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34326 expref: 19 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.488778:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:2.0:1788652245.488782:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788652245.488787:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5d79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34326 expref: 19 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.488801:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86fc58e800, rc 0) 00000100:00100000:2.0:1788652245.488868:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+18:18799:x1875537125607168:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 991us (1255us total) trans 12884901898 rc 301/301 00000100:00100000:2.0:1788652245.488876:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 39 00000100:00100000:3.0:1788652245.493109:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652245.493452:0:22753:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125607424 00000100:00100000:1.0:1788652245.493465:0:22753:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125607424 00000100:00100000:1.0:1788652245.493590:0:22753:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:1.0:1788652245.493602:0:22753:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+18:18799:x1875537125607424:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:1.0:1788652245.493866:0:22753:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+19:18799:x1875537125607424:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 265us (765us total) trans 12884901899 rc 0/0 00000100:00100000:1.0:1788652245.493875:0:22753:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:3.0:1788652245.528258:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.530371:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125607680 00000100:00100000:0.0:1788652245.530410:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125607680 00000100:00100000:0.0:1788652245.530546:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 40 00000100:00100000:0.0:1788652245.530558:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+19:18802:x1875537125607680:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788652245.530601:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652245.530627:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5d87 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3432d expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.530745:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5d8e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.530761:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5d8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.530783:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5d8e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652245.530794:0:22751:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788652245.530931:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5d87 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3432d expref: 22 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.530952:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5d8e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3432d expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.530961:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:0.0:1788652245.530964:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788652245.530968:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96000, rc 0) 00000100:00100000:0.0:1788652245.531050:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+21:18802:x1875537125607680:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 494us (5017us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788652245.531057:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 40 00000100:00100000:3.0:1788652245.539850:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.540049:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125607808 00000100:00100000:0.0:1788652245.540064:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125607808 00000100:00100000:1.0:1788652245.540173:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 41 00000100:00100000:1.0:1788652245.540185:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+21:18802:x1875537125607808:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:1.0:1788652245.540401:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5d9c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.540419:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5d9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.540432:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5d9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.540473:0:23985:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5d9c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.540488:0:23985:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5d9c lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.540496:0:23985:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5d9c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.540502:0:23985:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652245.540517:0:23985:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5d9c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.540526:0:23985:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5d9c lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.540547:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:1.0:1788652245.540550:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788652245.540554:0:23985:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5d9c lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.540561:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5d9c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652245.540685:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+21:18802:x1875537125607808:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 499us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652245.540693:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 41 00000100:00100000:3.0:1788652245.541889:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652245.542685:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125607936 00000100:00100000:2.0:1788652245.542697:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125607936 00000100:00100000:2.0:1788652245.542825:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:2.0:1788652245.542836:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+21:2388:x1875537125607936:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652245.542852:0:22737:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652245.542884:0:22737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5d8e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3432d expref: 21 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.542946:0:22737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:2.0:1788652245.542953:0:22737:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652245.543003:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+20:2388:x1875537125607936:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 169us (1119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652245.543011:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:3.0:1788652245.543249:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652245.543325:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125608192 00000100:00100000:3.0:1788652245.543330:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125608192 00000100:00100000:3.0:1788652245.543372:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:3.0:1788652245.543379:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+20:18802:x1875537125608192:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:3.0:1788652245.543841:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+21:18802:x1875537125608192:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 460us (591us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1788652245.543849:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000040:00080000:3.0:1788652245.665681:0:23505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788652245.850204:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652245.850324:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125608448 00000100:00100000:2.0:1788652245.850348:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125608448 00000100:00100000:2.0:1788652245.850416:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 42 00000100:00100000:2.0:1788652245.850426:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+21:18834:x1875537125608448:12345-192.168.204.45@tcp:101:cat.0 00010000:00010000:2.0:1788652245.850452:0:22752:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652245.850476:0:22752:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5da3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34334 expref: -99 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.850602:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58ec00/0xcd2f56ea038c5daa lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.850618:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58ec00/0xcd2f56ea038c5daa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.850843:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58ec00/0xcd2f56ea038c5daa lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652245.850857:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788652245.851034:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5da3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34334 expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.851054:0:22752:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58ec00/0xcd2f56ea038c5daa lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34334 expref: 23 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.851076:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:2.0:1788652245.851079:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652245.851084:0:22752:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86fc58ec00, rc 0) 00000100:00100000:2.0:1788652245.851277:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+23:18834:x1875537125608448:12345-192.168.204.45@tcp:101:cat.0 Request processed in 852us (1082us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788652245.851285:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 42 00000040:00080000:2.0:1788652245.856528:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788652245.872214:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652245.872418:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652245.872796:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125608704 00000100:00100000:3.0:1788652245.872807:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125608704 00000100:00100000:3.0:1788652245.872867:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:3.0:1788652245.872876:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+23:18834:x1875537125608704:12345-192.168.204.45@tcp:35:cat.0 00000100:00100000:3.0:1788652245.873195:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+24:18834:x1875537125608704:12345-192.168.204.45@tcp:35:cat.0 Request processed in 319us (992us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1788652245.873204:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:2.0:1788652245.877832:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125608832 00000100:00100000:2.0:1788652245.877849:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125608832 00000100:00100000:2.0:1788652245.878070:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 1 00000100:00100000:2.0:1788652245.878081:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+24:2388:x1875537125608832:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652245.878096:0:22736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652245.878121:0:22736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58ec00/0xcd2f56ea038c5daa lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34334 expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652245.878139:0:22736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:2.0:1788652245.878144:0:22736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652245.878397:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+23:2388:x1875537125608832:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 317us (6137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652245.878405:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 1 00000100:00100000:1.0:1788652245.955469:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652245.955731:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125609088 00000100:00100000:2.0:1788652245.955743:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125609088 00000100:00100000:2.0:1788652245.955850:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 43 00000100:00100000:2.0:1788652245.955862:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+23:18840:x1875537125609088:12345-192.168.204.45@tcp:101:dd.0 00010000:00010000:2.0:1788652245.955888:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652245.955965:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58ec00/0xcd2f56ea038c5db8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3433b expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.956574:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c5dbf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.956604:0:22750:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5d5d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34318 expref: 24 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.956614:0:22750:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3431f expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.956623:0:22750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c5dbf lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.956728:0:22750:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3431f expref: 24 pid: 22752 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.956743:0:22750:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3431f expref: 24 pid: 22752 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652245.956985:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22750:1875537147736704:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788652245.957266:0:22750:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5d5d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34318 expref: 24 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.957277:0:22750:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5d5d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34318 expref: 24 pid: 23985 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652245.957288:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22750:1875537147736832:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788652245.957313:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c23e1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788652245.959859:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbd880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22750:1875537147736704:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788652245.960764:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652245.960880:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125609216 00000100:00100000:3.0:1788652245.960891:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125609216 00010000:00010000:3.0:1788652245.960979:0:24282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3431f expref: 25 pid: 22752 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652245.961035:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:3.0:1788652245.961045:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+25:2389:x1875537125609216:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652245.961062:0:24282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652245.961069:0:24282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3431f expref: 25 pid: 22752 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.961081:0:24282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3431f expref: 25 pid: 22752 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.961103:0:24282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e200/0xcd2f56ea038c5d72 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3431f expref: 25 pid: 22752 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.961119:0:24282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:3.0:1788652245.961125:0:24282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c5dbf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.961134:0:24282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c5dbf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.961141:0:24282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652245.961233:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+24:2389:x1875537125609216:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 190us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652245.961241:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:0.0:1788652245.962362:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22750:1875537147736832:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788652245.962473:0:22750:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c5dbf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652245.962626:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652245.962751:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125609344 00000100:00100000:1.0:1788652245.962759:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125609344 00010000:00010000:1.0:1788652245.962792:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5d5d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34318 expref: 24 pid: 23985 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652245.962833:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:1.0:1788652245.962842:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f4adb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+24:2390:x1875537125609344:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652245.962855:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652245.962872:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5d5d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34318 expref: 24 pid: 23985 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.962884:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5d5d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34318 expref: 24 pid: 23985 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.962926:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5d5d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34318 expref: 24 pid: 23985 timeout: 801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.962944:0:22735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:1.0:1788652245.962948:0:22735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c5dbf lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.962959:0:22735:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c5dbf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.962967:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c5dbf lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652245.963000:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652245.963060:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f4adb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+23:2390:x1875537125609344:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 218us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652245.963068:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 18 00010000:00010000:0.0:1788652245.963857:0:22750:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c5dbf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.963867:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c5dbf lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652245.963889:0:22750:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788652245.965099:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58ec00/0xcd2f56ea038c5db8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3433b expref: 24 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.965188:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c5dbf lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3433b expref: 23 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.965199:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:0.0:1788652245.965202:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788652245.965258:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6000, rc 0) 00000100:00100000:0.0:1788652245.965348:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+23:18840:x1875537125609088:12345-192.168.204.45@tcp:101:dd.0 Request processed in 9475us (9878us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788652245.965356:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 43 00000100:00100000:3.0:1788652245.968437:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652245.968560:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125609472 00000100:00100000:0.0:1788652245.968571:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125609472 00000100:00100000:0.0:1788652245.968791:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 44 00000100:00100000:0.0:1788652245.968810:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+23:18840:x1875537125609472:12345-192.168.204.45@tcp:101:dd.0 00010000:00010000:0.0:1788652245.969064:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652245.969087:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5dcd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34342 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.969126:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5dd4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.969152:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5dd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.969167:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5dd4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.969364:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5dcd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34342 expref: 25 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.969384:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5dd4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34342 expref: 24 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.969392:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:0.0:1788652245.969395:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788652245.969399:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96e00, rc 0) 00000100:00100000:0.0:1788652245.969466:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+24:18840:x1875537125609472:12345-192.168.204.45@tcp:101:dd.0 Request processed in 659us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.969474:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 44 00000100:00100000:1.0:1788652245.973187:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652245.973345:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125609728 00000100:00100000:3.0:1788652245.973356:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125609728 00000100:00100000:3.0:1788652245.973418:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 45 00000100:00100000:3.0:1788652245.973429:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+24:18840:x1875537125609728:12345-192.168.204.45@tcp:36:dd.0 00010000:00010000:3.0:1788652245.973633:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c5ddb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.973651:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c5ddb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.973663:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c5ddb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788652245.973704:0:23985:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:3.0:1788652245.973727:0:23985:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a80c8f7a reply state 00000000eaaebaef transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c5ddb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.973741:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c5ddb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.973748:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:3.0:1788652245.973751:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788652245.973756:0:23985:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788652245.974111:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+27:18840:x1875537125609728:12345-192.168.204.45@tcp:36:dd.0 Request processed in 682us (933us total) trans 12884901906 rc 0/0 00000100:00100000:3.0:1788652245.974119:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 45 00000020:00080000:3.0:1788652245.974124:0:23985:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788652245.976451:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652245.976583:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125609856 00000100:00100000:2.0:1788652245.976594:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125609856 00000100:00100000:0.0:1788652245.976727:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 46 00000100:00100000:0.0:1788652245.976742:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+27:18840:x1875537125609856:12345-192.168.204.45@tcp:101:dd.0 00010000:00010000:0.0:1788652245.976785:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652245.976806:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5de2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34349 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.976868:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5de2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34349 expref: 28 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.976886:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5de2 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34349 expref: 28 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652245.976939:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:0.0:1788652245.976943:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652245.976947:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96600, rc 0) 00000100:00100000:0.0:1788652245.977011:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+28:18840:x1875537125609856:12345-192.168.204.45@tcp:101:dd.0 Request processed in 273us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.977019:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 46 00000100:00100000:2.0:1788652245.990173:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147736960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788652245.990264:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652245.993594:0:24261:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147736960 00000100:00100000:0.0:1788652245.993617:0:24261:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147736960 00000100:00100000:0.0:1788652245.993775:0:24261:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788652245.993793:0:24261:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f67aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147736960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788652245.993831:0:24261:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788652245.993875:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652245.993955:0:24261:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f67aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147736960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 170us (3691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652245.993964:0:24261:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788652245.994059:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147736960:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788652245.994953:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652245.995164:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125610112 00000100:00100000:3.0:1788652245.995172:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125610112 00000100:00100000:3.0:1788652245.995231:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:3.0:1788652245.995239:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+28:18840:x1875537125610112:12345-192.168.204.45@tcp:103:dd.0 00010000:00010000:3.0:1788652245.995265:0:24282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652245.995290:0:24282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5de2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34349 expref: 28 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652245.995308:0:24282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:3.0:1788652245.995314:0:24282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652245.995410:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+27:18840:x1875537125610112:12345-192.168.204.45@tcp:103:dd.0 Request processed in 171us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652245.995418:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:1.0:1788652246.019449:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652246.021112:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125610240 00000100:00100000:0.0:1788652246.021128:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125610240 00000100:00100000:0.0:1788652246.021251:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 47 00000100:00100000:0.0:1788652246.021277:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+27:18840:x1875537125610240:12345-192.168.204.45@tcp:58:dd.0 00010000:00010000:0.0:1788652246.021391:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5de9 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.021408:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5de9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.021420:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5de9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652246.026523:0:22750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652246.026557:0:22750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1788652246.026736:0:22750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1788652246.026856:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+27:18840:x1875537125610240:12345-192.168.204.45@tcp:58:dd.0 Request processed in 5575us (7412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652246.026869:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 47 00000100:00100000:1.0:1788652246.033744:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652246.033872:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125610368 00000100:00100000:0.0:1788652246.033883:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125610368 00000100:00100000:0.0:1788652246.034064:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 48 00000100:00100000:0.0:1788652246.034076:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+27:18840:x1875537125610368:12345-192.168.204.45@tcp:101:dd.0 00010000:00010000:0.0:1788652246.034099:0:22751:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652246.034122:0:22751:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5df0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34350 expref: -99 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.034181:0:22751:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5de9 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.034194:0:22751:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5df0 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34350 expref: 28 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.034235:0:22751:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5de9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.034249:0:22751:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5df0 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34350 expref: 28 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.034261:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:0.0:1788652246.034264:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652246.034268:0:22751:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5df0 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34350 expref: 28 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.034276:0:22751:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96600, rc 0) 00000100:00100000:0.0:1788652246.034383:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+28:18840:x1875537125610368:12345-192.168.204.45@tcp:101:dd.0 Request processed in 310us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652246.034391:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 48 00010000:00010000:3.0:1788652246.435154:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652246.497185:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147737088:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788652246.497284:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652246.498105:0:22755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147737088 00000100:00100000:2.0:1788652246.498116:0:22755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147737088 00000100:00100000:2.0:1788652246.498187:0:22755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788652246.498199:0:22755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147737088:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788652246.498235:0:22755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788652246.498285:0:22755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147737088:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652246.498292:0:22755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788652246.500011:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147737088:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788652246.880254:0:22786:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788652246.880264:0:22786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788652246.880298:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788652246.880307:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788652246.880448:0:22786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22786:1875537147737216:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788652246.880537:0:22786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652246.886115:0:22786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22786:1875537147737216:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788652246.893712:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652246.894480:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125610496 00000100:00100000:2.0:1788652246.894493:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125610496 00000100:00100000:2.0:1788652246.894584:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 49 00000100:00100000:2.0:1788652246.894595:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+28:18842:x1875537125610496:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788652246.894658:0:23985:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788652246.894796:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+28:18842:x1875537125610496:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 203us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652246.895536:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 49 00000100:00100000:1.0:1788652246.900708:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652246.900838:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125610624 00000100:00100000:2.0:1788652246.900850:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125610624 00000100:00100000:2.0:1788652246.901042:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 50 00000100:00100000:2.0:1788652246.901114:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+28:18842:x1875537125610624:12345-192.168.204.45@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788652246.901201:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5df7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901220:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5df7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901232:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5df7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901294:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5dfe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901301:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5dfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901309:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5dfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901344:0:22752:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e05 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901354:0:22752:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901376:0:22752:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652246.901423:0:22752:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788652246.901428:0:22752:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788652246.901441:0:22752:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901453:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5df7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901460:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5df7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901468:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5df7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901474:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86fc58e800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652246.901478:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5df7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901487:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5df7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901499:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f85c2857a00) 00010000:00010000:2.0:1788652246.901502:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652246.901507:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5df7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901514:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5df7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901539:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5dfe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901545:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5dfe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901550:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5dfe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901555:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86fc58e000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652246.901558:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5dfe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901564:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5dfe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901572:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8f86c3228100) 00010000:00010000:2.0:1788652246.901574:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652246.901577:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5dfe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901582:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5dfe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901597:0:22752:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e05 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901603:0:22752:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e05 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901609:0:22752:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.901621:0:22752:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86fc58f000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652246.901625:0:22752:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e05 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.902350:0:22752:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e05 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.902362:0:22752:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:2.0:1788652246.902364:0:22752:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652246.902368:0:22752:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e05 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.902374:0:22752:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e05 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22752 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652246.902475:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+28:18842:x1875537125610624:12345-192.168.204.45@tcp:34:lhsmtool_posix.0 Request processed in 1364us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652246.906156:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652246.906237:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125610880 00000100:00100000:3.0:1788652246.906250:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125610880 00000100:00100000:2.0:1788652246.917055:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 50 00000100:00100000:3.0:1788652246.917387:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 51 00000100:00100000:3.0:1788652246.917409:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+28:18842:x1875537125610880:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788652246.917434:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652246.917456:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34357 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.917863:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e13 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.917882:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e13 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.917982:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e13 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652246.917997:0:22750:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788652246.918106:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e13 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.918115:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e13 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.918289:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e13 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.918298:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788652246.918307:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e13 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.918325:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e13 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.918339:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:3.0:1788652246.918342:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788652246.918347:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e13 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.918353:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e13 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.919044:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e0c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34357 expref: 30 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.919057:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f85c2857a00) 00010000:00010000:3.0:1788652246.919060:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788652246.919064:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34357 expref: 30 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.919089:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6800, rc 0) 00000100:00100000:3.0:1788652246.922083:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+29:18842:x1875537125610880:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 4392us (15645us total) trans 12884901907 rc 301/301 00000100:00100000:3.0:1788652246.922099:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 51 00000100:00100000:1.0:1788652246.927558:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652246.927650:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125611008 00000100:00100000:0.0:1788652246.927661:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125611008 00000100:00100000:0.0:1788652246.927724:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 52 00000100:00100000:0.0:1788652246.927734:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+29:18842:x1875537125611008:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788652246.927770:0:22751:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788652246.927966:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+29:18842:x1875537125611008:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 233us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652246.927975:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 52 00000100:00100000:1.0:1788652246.937478:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652246.937620:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125611264 00000100:00100000:2.0:1788652246.937641:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125611264 00000100:00100000:2.0:1788652246.937711:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:2.0:1788652246.937723:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+29:18842:x1875537125611264:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652246.937745:0:23985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652246.937769:0:23985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e21 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3435e expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788652246.938641:0:23985:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =60 00000004:00080000:2.0:1788652246.938649:0:23985:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+60 in llog 00000004:00080000:2.0:1788652246.938687:0:23985:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788652246.938841:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5e28 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.938858:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5e28 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.938871:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5e28 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.938969:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e21 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3435e expref: 32 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.938990:0:23985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5e28 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3435e expref: 31 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.939001:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f86c3228100) 00010000:00010000:2.0:1788652246.939004:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652246.939007:0:23985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86fc58e000, rc 0) 00000100:00100000:2.0:1788652246.939084:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+31:18842:x1875537125611264:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 1364us (1617us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788652246.939094:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:1.0:1788652246.945955:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652246.946120:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125611520 00000100:00100000:0.0:1788652246.946139:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125611520 00000100:00100000:0.0:1788652246.946213:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00100000:0.0:1788652246.946241:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+31:18842:x1875537125611520:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788652246.946305:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652246.946343:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e000/0xcd2f56ea038c5e28 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3435e expref: 31 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946362:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f86c3228100) 00010000:00010000:0.0:1788652246.946374:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652246.946397:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e36 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946411:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946421:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946447:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e3d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x419027e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946454:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e3d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x419027e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946461:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e3d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x419027e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946509:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e36 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946517:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e36 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946533:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e36 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946539:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652246.946543:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e36 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946551:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e36 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946561:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788652246.946564:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652246.946568:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e36 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946575:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e36 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946584:0:22751:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e3d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x419027e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946590:0:22751:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e3d lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x419027e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946595:0:22751:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e3d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x419027e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946600:0:22751:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652246.946603:0:22751:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e3d lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x419027e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946619:0:22751:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e3d lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x419027e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946640:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x419027e (ffff8f85c2857d00) 00010000:00010000:0.0:1788652246.946643:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652246.946646:0:22751:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e3d lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x419027e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.946652:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e3d lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x419027e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652246.946740:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+30:18842:x1875537125611520:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 501us (797us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788652246.946749:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00100000:1.0:1788652246.950798:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652246.950904:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125611648 00000100:00100000:2.0:1788652246.950955:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125611648 00000100:00100000:2.0:1788652246.951242:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 55 00000100:00100000:2.0:1788652246.951254:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+30:18842:x1875537125611648:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652246.951276:0:23985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652246.951322:0:23985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e44 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34365 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.951382:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5e4b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.951395:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5e4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.951406:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5e4b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.951511:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e44 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34365 expref: 32 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.951533:0:23985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58e800/0xcd2f56ea038c5e4b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34365 expref: 31 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652246.951543:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:2.0:1788652246.951547:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788652246.951550:0:23985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86fc58e800, rc 0) 00000100:00100000:2.0:1788652246.951617:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+31:18842:x1875537125611648:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 366us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652246.951624:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 55 00000100:00100000:1.0:1788652246.965337:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652246.965447:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125611904 00000100:00100000:0.0:1788652246.965459:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125611904 00000100:00100000:0.0:1788652246.965539:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 56 00000100:00100000:0.0:1788652246.965552:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+31:18842:x1875537125611904:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788652246.965659:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e52 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.965678:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.965692:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652246.965866:0:22751:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1788652246.965877:0:22751:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 702900968915ns, next at 703900966225ns, rc = 0 00000004:00010000:0.0:1788652246.965977:0:22751:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086bbe8f7 reply state 00000000024946b3 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e52 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.965992:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e52 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652246.966000:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:0.0:1788652246.966003:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788652246.966006:0:22751:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652246.966410:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6ec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+33:18842:x1875537125611904:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 858us (1090us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788652246.966419:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 56 00000100:00100000:1.0:1788652246.968903:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652246.969001:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125612032 00000100:00100000:3.0:1788652246.969012:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125612032 00000100:00100000:3.0:1788652246.969070:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:3.0:1788652246.969081:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+33:18842:x1875537125612032:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788652246.969107:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652246.969127:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e59 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3436c expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.969539:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e59 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3436c expref: 34 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.969555:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e59 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3436c expref: 34 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652246.969576:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:3.0:1788652246.969580:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788652246.969584:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6800, rc 0) 00000100:00100000:3.0:1788652246.969650:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6eca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+34:18842:x1875537125612032:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 571us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652246.969657:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:1.0:1788652246.977447:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652246.977545:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125612160 00000100:00100000:2.0:1788652246.977556:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125612160 00000100:00100000:2.0:1788652246.977629:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:2.0:1788652246.977642:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2388:x1875537125612160:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788652246.977892:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:2388:x1875537125612160:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 Request processed in 253us (455us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788652246.977951:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00080000:1.0:1788652246.980972:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652246.992040:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652246.992132:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125612416 00000100:00100000:3.0:1788652246.992162:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125612416 00000100:00100000:3.0:1788652246.992288:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:3.0:1788652246.992373:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+34:18842:x1875537125612416:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788652246.992651:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6ec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+35:18842:x1875537125612416:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 282us (623us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1788652246.992660:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:0.0:1788652247.002696:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652247.002796:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125612672 00000100:00100000:2.0:1788652247.002808:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125612672 00000100:00100000:2.0:1788652247.002890:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:2.0:1788652247.002902:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+35:18842:x1875537125612672:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788652247.003078:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+35:18842:x1875537125612672:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 178us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652247.003087:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00080000:1.0:1788652247.003168:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652247.006982:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652247.007295:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125612800 00000100:00100000:2.0:1788652247.007307:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125612800 00000100:00100000:2.0:1788652247.007379:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:2.0:1788652247.007390:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+35:18842:x1875537125612800:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652247.007412:0:23985:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652247.007433:0:23985:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e60 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34373 expref: -99 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.007533:0:23985:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f400/0xcd2f56ea038c5e67 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.007550:0:23985:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f400/0xcd2f56ea038c5e67 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.007561:0:23985:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f400/0xcd2f56ea038c5e67 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652247.007604:0:23985:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788652247.009068:0:23985:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f400/0xcd2f56ea038c5e67 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.009243:0:23985:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f000/0xcd2f56ea038c5e60 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34373 expref: 37 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.009269:0:23985:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f400/0xcd2f56ea038c5e67 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34373 expref: 36 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.009279:0:23985:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:2.0:1788652247.009282:0:23985:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788652247.009286:0:23985:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86fc58f400, rc 0) 00000100:00100000:2.0:1788652247.009375:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+36:18842:x1875537125612800:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 1987us (2404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652247.009384:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:2.0:1788652247.011625:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652247.011696:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147737344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788652247.011755:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652247.011972:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147737344 00000100:00100000:3.0:1788652247.011982:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147737344 00000100:00100000:3.0:1788652247.012331:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788652247.012343:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147737344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788652247.012382:0:22756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788652247.012442:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147737344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652247.012449:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788652247.012695:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147737344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788652247.016174:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652247.016538:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125612928 00000100:00100000:1.0:1788652247.016550:0:25157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125612928 00000100:00100000:1.0:1788652247.016647:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:1.0:1788652247.016658:0:25157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1867a2b2-cc26-44de-896f-c5dbaa28edb1+6:2389:x1875537125612928:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788652247.016679:0:25157:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652247.016704:0:25157:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d14a869a/0xcd2f56ea038c5e6e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3437a expref: -99 pid: 25157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788652247.016737:0:25157:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9caad6, blocks: 0x0 00010000:00010000:1.0:1788652247.016760:0:25157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=702s v=(0 0) 00010000:00010000:1.0:1788652247.016765:0:25157:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652247.016775:0:25157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d14a869a/0xcd2f56ea038c5e6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3437a expref: 7 pid: 25157 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.016812:0:25157:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d14a869a/0xcd2f56ea038c5e6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3437a expref: 7 pid: 25157 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.016826:0:25157:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414400, rc 0) 00000100:00100000:1.0:1788652247.016896:0:25157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:2389:x1875537125612928:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 241us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652247.016904:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:0.0:1788652247.020369:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652247.020641:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125613184 00000100:00100000:2.0:1788652247.020653:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125613184 00000100:00100000:2.0:1788652247.020751:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:2.0:1788652247.020764:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+36:18842:x1875537125613184:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788652247.020882:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+36:18842:x1875537125613184:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 121us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652247.020890:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:3.0:1788652247.027082:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652247.027402:0:23985:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125613312 00000100:00100000:2.0:1788652247.027415:0:23985:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125613312 00000100:00100000:2.0:1788652247.027529:0:23985:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 61 00000100:00100000:2.0:1788652247.027540:0:23985:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+36:18842:x1875537125613312:12345-192.168.204.45@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788652247.031643:0:22730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1788652247.031662:0:22730:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788652247.031732:0:22730:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:2.0:1788652247.031862:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c6f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.031874:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c6f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.031883:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.031889:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652247.031893:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c6f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.031901:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c6f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.031942:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8f86c3228b00) 00010000:00010000:2.0:1788652247.031945:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652247.031950:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c6f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.031956:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c5c6f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.031978:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c76 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.031985:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c76 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652247.032000:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1788652247.032009:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c76 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652247.032021:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f6ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147737472:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1788652247.032027:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652247.032029:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c76 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032036:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c76 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032044:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788652247.032046:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652247.032049:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c76 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032054:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc200/0xcd2f56ea038c5c76 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032065:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c5d56 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032071:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c5d56 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032076:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c5d56 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032080:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652247.032082:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c5d56 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652247.032095:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788652247.032101:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c5d56 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032109:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8f86c3a1b100) 00010000:00010000:2.0:1788652247.032111:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652247.032113:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c5d56 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032119:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c5d56 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032145:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c5ddb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032152:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c5ddb lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032158:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c5ddb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032163:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652247.032165:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c5ddb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032171:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c5ddb lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032179:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:2.0:1788652247.032182:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652247.032185:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c5ddb lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032197:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c5ddb lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23985 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032219:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e52 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032225:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e52 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032230:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e52 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032235:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652247.032238:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e52 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032244:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e52 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032253:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:2.0:1788652247.032255:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788652247.032258:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e52 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.032264:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c5e52 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652247.032334:0:24256:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147737472 00000100:00100000:1.0:1788652247.032343:0:24256:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147737472 00000100:00100000:2.0:1788652247.032408:0:23985:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+15:18842:x1875537125613312:12345-192.168.204.45@tcp:44:lhsmtool_posix.0 Request processed in 4867us (5332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652247.032412:0:24256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788652247.032418:0:23985:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 61 00000100:00100000:1.0:1788652247.032422:0:24256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147737472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788652247.032545:0:24256:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788652247.032549:0:24256:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788652247.032551:0:24256:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788652247.032553:0:24256:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788652246 -> 1788652246 00002000:00010000:1.0:1788652247.032555:0:24256:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788652247.032593:0:24256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6ec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875537147737472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (498us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1788652247.032600:0:24256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788652247.032666:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788652247.032743:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cfb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.032752:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cfb lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.032757:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cfb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.032762:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788652247.032765:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cfb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.032781:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cfb lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.032790:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:3.0:1788652247.032792:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788652247.032795:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cfb lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.032801:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c5cfb lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788652247.032849:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f86f6ecbb80/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788652247.032856:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f6ecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147737472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788652247.035959:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652247.036092:0:24745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125613440 00000100:00100000:2.0:1788652247.036102:0:24745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125613440 00000100:00100000:2.0:1788652247.036173:0:24745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:2.0:1788652247.036182:0:24745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:2389:x1875537125613440:12345-192.168.204.45@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788652247.036300:0:24745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:2389:x1875537125613440:12345-192.168.204.45@tcp:16:lhsmtool_posix.0 Request processed in 118us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652247.036308:0:24745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:2.0:1788652247.040191:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652247.041518:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125613696 00000100:00100000:0.0:1788652247.041538:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125613696 00000100:00100000:0.0:1788652247.041731:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 62 00000100:00100000:0.0:1788652247.041745:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+15:18842:x1875537125613696:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788652247.041810:0:22751:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788652247.041842:0:22751:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f400/0xcd2f56ea038c5e67 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34373 expref: 15 pid: 23985 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.041860:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:0.0:1788652247.041865:0:22751:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652247.041932:0:22751:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e75 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.041947:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e75 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.041958:0:22751:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e75 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788652247.042087:0:22751:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb6805ce reply state 0000000094169412 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e75 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.042099:0:22751:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c5e75 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22751 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.042105:0:22751:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:0.0:1788652247.042108:0:22751:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788652247.042111:0:22751:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652247.042249:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+16:18842:x1875537125613696:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 506us (2068us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788652247.042256:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 62 00000100:00100000:3.0:1788652247.045285:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652247.045959:0:25157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125613824 00000100:00100000:1.0:1788652247.045970:0:25157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125613824 00000100:00100000:1.0:1788652247.046043:0:25157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:1.0:1788652247.046069:0:25157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1867a2b2-cc26-44de-896f-c5dbaa28edb1+7:2388:x1875537125613824:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788652247.046225:0:25157:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788652247.046229:0:25157:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788652245 00002000:00010000:1.0:1788652247.046231:0:25157:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788652245 00002000:00010000:1.0:1788652247.046233:0:25157:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788652246 -> 1788652245 00002000:00010000:1.0:1788652247.046236:0:25157:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788652247.046381:0:25157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1867a2b2-cc26-44de-896f-c5dbaa28edb1+8:2388:x1875537125613824:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 Request processed in 313us (1105us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788652247.046389:0:25157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:1.0:1788652247.050277:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652247.050582:0:24258:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125613952 00000100:00100000:2.0:1788652247.050593:0:24258:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125613952 00000100:00100000:2.0:1788652247.050749:0:24258:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:2.0:1788652247.050762:0:24258:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86efdbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+8:2391:x1875537125613952:12345-192.168.204.45@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788652247.050809:0:24258:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000800ecab/0xcd2f56ea038c5e7c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.050826:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652247.050830:0:24258:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652247.050837:0:24258:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000800ecab/0xcd2f56ea038c5e7c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.050850:0:24258:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000800ecab/0xcd2f56ea038c5e7c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.050877:0:24258:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000800ecab/0xcd2f56ea038c5e7c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.050900:0:24258:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000800ecab/0xcd2f56ea038c5e7c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.050926:0:24258:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000800ecab/0xcd2f56ea038c5e7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.050934:0:24258:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86fc58f800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652247.050939:0:24258:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000800ecab/0xcd2f56ea038c5e7c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.050949:0:24258:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000800ecab/0xcd2f56ea038c5e7c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.050966:0:24258:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000800ecab/0xcd2f56ea038c5e7c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.050975:0:24258:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000800ecab/0xcd2f56ea038c5e7c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24258 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652247.051059:0:24258:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86efdbb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+8:2391:x1875537125613952:12345-192.168.204.45@tcp:1:lhsmtool_posix.0 Request processed in 300us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652247.051067:0:24258:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:2.0:1788652247.054095:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652247.054175:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125614208 00000100:00100000:3.0:1788652247.054185:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125614208 00000100:00100000:3.0:1788652247.054244:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 63 00000100:00100000:3.0:1788652247.054253:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+16:18842:x1875537125614208:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788652247.054363:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.054381:0:22750:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5dd4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34342 expref: 16 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.054390:0:22750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.054425:0:22750:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5dd4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34342 expref: 16 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.054457:0:22750:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5dd4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34342 expref: 16 pid: 22751 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652247.054477:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22750:1875537147737600:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788652247.054555:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c23e1900 going to sleep for 11 seconds 00000100:00100000:0.0:1788652247.061423:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652247.061530:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22750:1875537147737600:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788652247.061559:0:22750:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652247.061596:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125614336 00000100:00100000:1.0:1788652247.061604:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125614336 00010000:00010000:1.0:1788652247.061643:0:22735:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5dd4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34342 expref: 17 pid: 22751 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652247.061686:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:1.0:1788652247.061695:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+17:2389:x1875537125614336:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652247.061710:0:22735:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652247.061717:0:22735:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5dd4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34342 expref: 17 pid: 22751 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.061728:0:22735:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5dd4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34342 expref: 17 pid: 22751 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.061750:0:22735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c5dd4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34342 expref: 17 pid: 22751 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.061783:0:22735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:1.0:1788652247.061789:0:22735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5df0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34350 expref: 16 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.061800:0:22735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.061808:0:22735:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.061816:0:22735:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.061845:0:22735:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788652247.061881:0:22750:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.061891:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652247.062143:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+17:2389:x1875537125614336:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 447us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652247.062152:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00010000:00010000:0.0:1788652247.062282:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.062296:0:22750:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e59 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3436c expref: 16 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.062325:0:22750:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.062357:0:22750:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e59 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3436c expref: 16 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.062372:0:22750:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e59 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3436c expref: 16 pid: 22750 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652247.062387:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22750:1875537147737728:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788652247.062442:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85ff9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652247.066222:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652247.066275:0:24282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125614464 00000100:00100000:1.0:1788652247.066285:0:24282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125614464 00000100:00100000:3.0:1788652247.066534:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22750:1875537147737728:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788652247.066541:0:24282:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e59 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3436c expref: 17 pid: 22750 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.066580:0:22750:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652247.066597:0:24282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:1.0:1788652247.066607:0:24282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+17:2388:x1875537125614464:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652247.066624:0:24282:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652247.066631:0:24282:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e59 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3436c expref: 17 pid: 22750 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.066664:0:24282:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e59 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3436c expref: 17 pid: 22750 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.066690:0:24282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5e59 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3436c expref: 17 pid: 22750 timeout: 802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.066707:0:24282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:1.0:1788652247.066712:0:24282:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.066721:0:24282:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.066728:0:24282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.066757:0:24282:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652247.066840:0:24282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+16:2388:x1875537125614464:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 234us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652247.066848:0:24282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 20 00010000:00010000:3.0:1788652247.068008:0:22750:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.068114:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788652247.068377:0:22750:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:3.0:1788652247.068523:0:22750:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:3.0:1788652247.068559:0:22750:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:3.0:1788652247.068713:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22750:1875537147737856:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788652247.068790:0:22750:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652247.068868:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34d36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652247.069209:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147737856 00000100:00100000:1.0:1788652247.069218:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147737856 00000100:00100000:1.0:1788652247.069305:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788652247.069327:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22750:x1875537147737856:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788652247.069420:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22750:x1875537147737856:12345-0@lo:1000:mdt00_000.0 Request processed in 105us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652247.069427:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788652247.069517:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22750:1875537147737856:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788652247.069711:0:22750:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1788652247.069761:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22750:1875537147737984:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788652247.069791:0:22750:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652247.070300:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49e8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652247.070401:0:22756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147737984 00000100:00100000:3.0:1788652247.070408:0:22756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147737984 00000100:00100000:2.0:1788652247.070537:0:22756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788652247.070546:0:22756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22750:x1875537147737984:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788652247.070836:0:22756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22750:x1875537147737984:12345-0@lo:1000:mdt00_000.0 Request processed in 291us (1044us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788652247.070846:0:22756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788652247.071493:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22750:1875537147737984:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788652247.071538:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071549:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071557:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071577:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652247.071582:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071591:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071607:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:0.0:1788652247.071610:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652247.071615:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071622:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c5e8a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071720:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5de9 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071727:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5de9 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071733:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5de9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071738:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652247.071742:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5de9 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071748:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5de9 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071765:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:0.0:1788652247.071768:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652247.071775:0:22750:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5df0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34350 expref: 19 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071787:0:22750:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5df0 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34350 expref: 19 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071797:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5df0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34350 expref: 19 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.071859:0:22750:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c5df0 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34350 expref: 19 pid: 22751 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652247.071874:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22750:1875537147738112:192.168.204.45@tcp:105: 00000100:00100000:0.0:1788652247.072100:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49e8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788652247.076653:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652247.076775:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125614592 00000100:00100000:1.0:1788652247.076785:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125614592 00000100:00100000:1.0:1788652247.076841:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:1.0:1788652247.076851:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c32ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+20:18840:x1875537125614592:12345-192.168.204.45@tcp:49:dd.0 00000100:00100000:1.0:1788652247.077056:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c32ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+20:18840:x1875537125614592:12345-192.168.204.45@tcp:49:dd.0 Request processed in 205us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652247.077064:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:3.0:1788652247.080592:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22750:1875537147738112:192.168.204.45@tcp:105: 00010000:00010000:3.0:1788652247.080645:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5de9 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.080656:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c5de9 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652247.080893:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00010000:00010000:2.0:1788652247.081054:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58fe00/0xcd2f56ea038c5e91 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081073:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58fe00/0xcd2f56ea038c5e91 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081087:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58fe00/0xcd2f56ea038c5e91 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081098:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58fe00/0xcd2f56ea038c5e91 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081104:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58fe00/0xcd2f56ea038c5e91 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081111:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58fe00/0xcd2f56ea038c5e91 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081117:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86fc58fe00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652247.081232:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58fe00/0xcd2f56ea038c5e91 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081242:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58fe00/0xcd2f56ea038c5e91 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081255:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:2.0:1788652247.081259:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652247.081262:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58fe00/0xcd2f56ea038c5e91 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081362:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58fe00/0xcd2f56ea038c5e91 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081376:0:22750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081382:0:22750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081388:0:22750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081393:0:22750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652247.081396:0:22750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081402:0:22750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081410:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:2.0:1788652247.081413:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788652247.081416:0:22750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081422:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c5e83 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652247.081642:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+19:18842:x1875537125614208:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 27388us (27555us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1788652247.081654:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 63 00000020:00080000:2.0:1788652247.081667:0:22750:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788652247.081697:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125614720 00000100:00100000:2.0:1788652247.081705:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125614720 00000100:00100000:2.0:1788652247.081752:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 64 00000100:00100000:2.0:1788652247.081763:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+19:18840:x1875537125614720:12345-192.168.204.45@tcp:101:dd.0 00010000:00010000:2.0:1788652247.081785:0:22750:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652247.081798:0:22750:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58fc00/0xcd2f56ea038c5e98 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34381 expref: -99 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081825:0:22750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f800/0xcd2f56ea038c5e9f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081834:0:22750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f800/0xcd2f56ea038c5e9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081841:0:22750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f800/0xcd2f56ea038c5e9f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22750 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.081988:0:22750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58fc00/0xcd2f56ea038c5e98 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34381 expref: 21 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.082007:0:22750:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86fc58f800/0xcd2f56ea038c5e9f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34381 expref: 20 pid: 22750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.082027:0:22750:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8f86c3a1b700) 00010000:00010000:2.0:1788652247.082030:0:22750:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788652247.082033:0:22750:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86fc58f800, rc 0) 00000040:00080000:0.0:1788652247.082265:0:22786:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788652247.082271:0:22786:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788652247.082299:0:22786:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788652247.082307:0:22786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788652247.082868:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+20:18840:x1875537125614720:12345-192.168.204.45@tcp:101:dd.0 Request processed in 1104us (1973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652247.082877:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 64 00000100:00100000:0.0:1788652247.085464:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652247.090458:0:22754:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125614976 00000100:00100000:1.0:1788652247.090473:0:22754:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125614976 00000100:00100000:1.0:1788652247.090542:0:22754:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00100000:1.0:1788652247.090563:0:22754:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+20:18842:x1875537125614976:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788652247.090872:0:22754:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788652247.090904:0:22754:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:1.0:1788652247.091233:0:22754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5ea6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.091251:0:22754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5ea6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.091264:0:22754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5ea6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.091273:0:22754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5ea6 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.091280:0:22754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5ea6 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.091286:0:22754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5ea6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.091336:0:22754:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652247.091483:0:22738:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652247.091491:0:22738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5ea6 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.091508:0:22738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652247.091512:0:22738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5ea6 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.091522:0:22738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5ea6 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.091534:0:22738:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:0.0:1788652247.091537:0:22738:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788652247.091542:0:22738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5ea6 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.091549:0:22738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c5ea6 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22754 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.091562:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652247.091563:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652247.091565:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652247.091596:0:22754:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+22:18842:x1875537125614976:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 1044us (6139us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788652247.091606:0:22754:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 11 00000020:00080000:1.0:1788652247.091612:0:22754:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788652247.187744:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652247.187952:0:24262:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125615104 00000100:00100000:1.0:1788652247.187967:0:24262:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125615104 00000100:00100000:1.0:1788652247.188052:0:24262:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:1.0:1788652247.188063:0:24262:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+8:2389:x1875537125615104:12345-192.168.204.45@tcp:4:dd.0 00010000:00010000:1.0:1788652247.188105:0:24262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.188129:0:24262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d14a869a/0xcd2f56ea038c5e6e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3437a expref: 8 pid: 25157 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.188139:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788652247.188143:0:24262:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652247.188149:0:24262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.188191:0:24262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d14a869a/0xcd2f56ea038c5e6e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3437a expref: 8 pid: 25157 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.188206:0:24262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d14a869a/0xcd2f56ea038c5e6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3437a expref: 8 pid: 25157 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652247.188257:0:24262:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f6ec8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24262:1875537147738240:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788652247.188479:0:24262:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fb18b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652247.189577:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652247.189654:0:24264:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788652247.189672:0:24264:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788652247.193057:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652247.193177:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125615360 00000100:00100000:3.0:1788652247.193189:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125615360 00010000:00010000:3.0:1788652247.193232:0:22736:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d14a869a/0xcd2f56ea038c5e6e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3437a expref: 9 pid: 25157 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652247.193280:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:3.0:1788652247.193377:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+9:2389:x1875537125615360:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652247.193394:0:22736:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652247.193417:0:22736:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d14a869a/0xcd2f56ea038c5e6e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3437a expref: 9 pid: 25157 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.193433:0:22736:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d14a869a/0xcd2f56ea038c5e6e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3437a expref: 9 pid: 25157 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.193462:0:22736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652247.193466:0:22736:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652247.193473:0:22736:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.193483:0:22736:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652247.193526:0:22736:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652247.193580:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1867a2b2-cc26-44de-896f-c5dbaa28edb1+9:2389:x1875537125615360:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 208us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652247.193587:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 21 00010000:00010000:2.0:1788652247.193973:0:24262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d14a869a/0xcd2f56ea038c5e6e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3437a expref: 8 pid: 25157 timeout: 803 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652247.193992:0:24262:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f6ec8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24262:1875537147738240:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788652247.194016:0:24262:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.194029:0:24262:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652247.194036:0:24262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652247.195070:0:24264:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125615232 00000100:00100000:1.0:1788652247.195079:0:24264:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125615232 00000100:00100000:1.0:1788652247.195577:0:25798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 1 00000100:00100000:1.0:1788652247.195589:0:25798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+8:2389:x1875537125615232:12345-192.168.204.45@tcp:4:dd.0 00010000:00010000:1.0:1788652247.195635:0:25798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5eb4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.195650:0:25798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652247.195655:0:25798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652247.195661:0:25798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.195673:0:25798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788652247.285551:0:24253:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1788652247.285568:0:24253:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:0.0:1788652247.287736:0:25798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1788652247.287747:0:25798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 1788652245 -> 1788652246 00002000:00010000:0.0:1788652247.287750:0:25798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788652245 -> 1788652246 00002000:00010000:0.0:1788652247.287753:0:25798:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 14952 00010000:00010000:0.0:1788652247.287771:0:25798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5eb4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.287786:0:25798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5eb4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.287815:0:25798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.287823:0:25798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652247.287829:0:25798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5eb4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.287839:0:25798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5eb4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.287860:0:25798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5eb4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652247.287869:0:25798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c5eb4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652247.288045:0:25798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1867a2b2-cc26-44de-896f-c5dbaa28edb1+9:2389:x1875537125615232:12345-192.168.204.45@tcp:4:dd.0 Request processed in 92453us (98465us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788652247.288060:0:25798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 1 00000001:00080000:3.0:1788652247.300796:0:24253:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00010000:00010000:1.0:1788652247.301050:0:24262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.301067:0:24262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.301076:0:24262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.301095:0:24262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652247.301100:0:24262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.301110:0:24262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.301273:0:24262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652247.301282:0:24262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029424c4e/0xcd2f56ea038c5ead lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652247.301477:0:24262:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2389:x1875537125615104:12345-192.168.204.45@tcp:4:dd.0 Request processed in 113410us (113739us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788652247.301488:0:24262:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 0 00010000:00010000:3.0:1788652247.456580:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652248.233757:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652248.233800:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652248.233830:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652248.233847:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652248.233866:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652248.233881:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652248.233903:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125615744 00000100:00100000:2.0:1788652248.233933:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125615744 00000100:00100000:2.0:1788652248.233991:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125616256 00000100:00100000:2.0:1788652248.233995:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125616256 00000100:00100000:2.0:1788652248.234008:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125615616 00000100:00100000:2.0:1788652248.234011:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125615616 00000100:00100000:2.0:1788652248.234042:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00100000:2.0:1788652248.234052:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2390:x1875537125615744:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652248.234202:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125616000 00000100:00100000:0.0:1788652248.234206:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125616000 00000100:00100000:0.0:1788652248.234236:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125616512 00000100:00100000:0.0:1788652248.234240:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125616512 00000100:00100000:0.0:1788652248.234265:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:0.0:1788652248.234272:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2390:x1875537125616000:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652248.234345:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2390:x1875537125616000:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 72us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652248.234353:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:0.0:1788652248.234372:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:0.0:1788652248.234379:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:2390:x1875537125616512:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652248.234403:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:2390:x1875537125616512:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 25us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652248.234409:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00080000:0.0:1788652248.234429:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652248.234433:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788652248.234464:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652248.234518:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652248.234595:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652248.234617:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125615872 00000100:00100000:0.0:1788652248.234621:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125615872 00000100:00100000:0.0:1788652248.234644:0:24259:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125616384 00000100:00100000:0.0:1788652248.234647:0:24259:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125616384 00000100:00100000:0.0:1788652248.234662:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:0.0:1788652248.234668:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2390:x1875537125615872:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652248.234696:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2390:x1875537125615872:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652248.234703:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:0.0:1788652248.234715:0:24259:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:0.0:1788652248.234721:0:24259:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:2390:x1875537125616384:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652248.234739:0:24259:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:2390:x1875537125616384:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 19us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652248.234752:0:24259:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00080000:0.0:1788652248.234768:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652248.234778:0:22745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125615488 00000100:00100000:0.0:1788652248.234781:0:22745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125615488 00000100:00100000:0.0:1788652248.234812:0:22745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 164 00000100:00100000:0.0:1788652248.234819:0:22745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:2390:x1875537125615488:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652248.234846:0:22745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3260450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bc7bbfba-a4c6-4a64-b3fb-1ab432999e1d+13:2390:x1875537125615488:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 28us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652248.234853:0:22745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 164 00000100:00100000:0.0:1788652248.234976:0:22752:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125616128 00000100:00100000:0.0:1788652248.234980:0:22752:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125616128 00000100:00080000:0.0:1788652248.234995:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652248.235016:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 55 00000100:00100000:0.0:1788652248.235022:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:2390:x1875537125616256:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652248.235053:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+5:2390:x1875537125616256:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 32us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652248.235059:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 55 00000100:00100000:0.0:1788652248.235091:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 56 00000100:00100000:0.0:1788652248.235115:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+22:2390:x1875537125615616:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652248.235145:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1867a2b2-cc26-44de-896f-c5dbaa28edb1+22:2390:x1875537125615616:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 47us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652248.235150:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 56 00000100:00100000:0.0:1788652248.235178:0:22752:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:0.0:1788652248.235185:0:22752:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:2390:x1875537125616128:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652248.235223:0:22752:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bfcf836d-8d6b-40c7-adfd-767bab831a9a+6:2390:x1875537125616128:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 39us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652248.235230:0:22752:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:2.0:1788652248.235665:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1867a2b2-cc26-44de-896f-c5dbaa28edb1+5:2390:x1875537125615744:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 1612us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652248.235674:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 54 00010000:00010000:2.0:1788652248.480391:0:25159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652248.544407:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788652248.544435:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147738368:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788652248.544511:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652248.544564:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147738368 00000100:00100000:3.0:1788652248.544573:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147738368 00000100:00100000:3.0:1788652248.544646:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788652248.544655:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147738368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788652248.544685:0:24260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788652248.544734:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147738368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652248.544741:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788652248.544790:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147738368:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788652248.544868:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652248.546504:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652248.546523:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147738496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652248.546582:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652248.546641:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147738496 00000100:00100000:3.0:1788652248.546649:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147738496 00000100:00100000:3.0:1788652248.546694:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788652248.546702:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147738496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652248.546725:0:24260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:3.0:1788652248.546789:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147738496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652248.546796:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788652248.546834:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1788652248.546840:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f86f6ecbb80, transno 12884901892 00000004:00080000:3.0:1788652248.546851:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1788652248.546880:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147738496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652248.547740:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147739008:0@lo:400:kworker.0 00000100:00100000:1.0:1788652248.547783:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652248.547816:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147739520:0@lo:400:kworker.0 00000100:00100000:1.0:1788652248.547839:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652248.547854:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147740032:0@lo:400:kworker.0 00000100:00100000:1.0:1788652248.547872:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652248.547892:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788652248.547897:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147738624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788652248.547955:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652248.547970:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147739136:0@lo:400:kworker.0 00000100:00100000:1.0:1788652248.547989:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652248.548006:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147739648:0@lo:400:kworker.0 00000100:00100000:1.0:1788652248.548024:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652248.548050:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147739520 00000100:00100000:1.0:1788652248.548056:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147739520 00000100:00100000:1.0:1788652248.548085:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147740032 00000100:00100000:1.0:1788652248.548088:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147740032 00000100:00100000:1.0:1788652248.548105:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147739136 00000100:00100000:1.0:1788652248.548107:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147739136 00000100:00100000:1.0:1788652248.548116:0:22750:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147739648 00000100:00100000:1.0:1788652248.548118:0:22750:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147739648 00000100:00100000:1.0:1788652248.548132:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788652248.548140:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147739520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652248.548199:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6ec9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147739520:12345-0@lo:400:kworker.0 Request processed in 59us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652248.548206:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788652248.548222:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788652248.548228:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147740032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652248.548256:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6ecaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147740032:12345-0@lo:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652248.548262:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788652248.548273:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788652248.548279:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147739136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652248.548314:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6ecad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147739136:12345-0@lo:400:kworker.0 Request processed in 37us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652248.548330:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788652248.548343:0:22750:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788652248.548348:0:22750:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147739648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652248.548375:0:22750:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6ec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147739648:12345-0@lo:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652248.548382:0:22750:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788652248.548416:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147739136:0@lo:400:kworker.0 00000100:00100000:1.0:1788652248.548425:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147739648:0@lo:400:kworker.0 00000100:00100000:1.0:1788652248.548433:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147739520:0@lo:400:kworker.0 00010000:00080000:1.0:1788652248.548445:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36b4380 x1875537147740032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652248.548454:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147740032:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.548857:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147738880:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.548898:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652248.548973:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147739392:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.548998:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652248.549015:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147739904:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.549036:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652248.549056:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788652248.549062:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147738752:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.549090:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652248.549114:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147739264:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.549146:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652248.549165:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147739776:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.549198:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652248.549227:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147738880 00000100:00100000:3.0:1788652248.549233:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147738880 00000100:00100000:3.0:1788652248.549270:0:23492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147739264 00000100:00100000:3.0:1788652248.549273:0:23492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147739264 00000100:00100000:3.0:1788652248.549300:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788652248.549307:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147738880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.549360:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147738880:12345-0@lo:400:kworker.0 Request processed in 53us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652248.549367:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788652248.549381:0:23492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788652248.549387:0:23492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147739264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.549414:0:23492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147739264:12345-0@lo:400:kworker.0 Request processed in 28us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652248.549420:0:23492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788652248.549438:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147739904 00000100:00100000:3.0:1788652248.549441:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147739904 00000100:00100000:3.0:1788652248.549466:0:22751:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147739776 00000100:00100000:3.0:1788652248.549469:0:22751:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147739776 00000100:00100000:3.0:1788652248.549482:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788652248.549488:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147739904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.549516:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147739904:12345-0@lo:400:kworker.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652248.549522:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788652248.549532:0:22751:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788652248.549537:0:22751:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147739776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.549562:0:22751:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147739776:12345-0@lo:400:kworker.0 Request processed in 25us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652248.549568:0:22751:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788652248.549868:0:24745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147739008 00000100:00100000:0.0:1788652248.549873:0:24745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147739008 00000100:00100000:0.0:1788652248.549922:0:24745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147739392 00000100:00100000:0.0:1788652248.549926:0:24745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147739392 00000100:00100000:0.0:1788652248.549949:0:24745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788652248.549956:0:24745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147739008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652248.550003:0:24745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6ec9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147739008:12345-0@lo:400:kworker.0 Request processed in 48us (2219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652248.550010:0:24745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788652248.550025:0:24745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788652248.550030:0:24745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147739392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652248.550056:0:24745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147739392:12345-0@lo:400:kworker.0 Request processed in 26us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652248.550061:0:24745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788652248.550086:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147738752 00000100:00100000:0.0:1788652248.550090:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147738752 00000100:00100000:0.0:1788652248.550115:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788652248.550121:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+24:3636:x1875537147738752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652248.550150:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f967659c-eb6d-423b-8189-3d2637ee2451+24:3636:x1875537147738752:12345-0@lo:400:kworker.0 Request processed in 29us (1060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652248.550163:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1788652248.550276:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788652248.550280:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652248.550292:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788652248.550295:0:22746:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788652248.550320:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147739008:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.550431:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147739264:0@lo:400:kworker.0 00010000:00080000:3.0:1788652248.550449:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36b6d80 x1875537147739776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652248.550459:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147739776:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.550477:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147738880:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.550486:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147739392:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.550495:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147739904:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.550517:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f967659c-eb6d-423b-8189-3d2637ee2451:3636:1875537147738752:0@lo:400:kworker.0 00000100:00100000:3.0:1788652248.550543:0:24260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147738624 00000100:00100000:3.0:1788652248.550547:0:24260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147738624 00000100:00100000:3.0:1788652248.550584:0:24260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788652248.550590:0:24260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147738624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788652248.552028:0:24260:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788652248.552127:0:24260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6ec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147738624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1534us (4168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652248.552147:0:24260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788652248.552228:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147738624:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788652248.736578:0:23505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:1.0:1788652249.054422:0:25835:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788652249.508789:0:22738:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652250.529163:0:22739:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13975 lines, 13975 kept, 0 dropped, 0 bad.