00000100:00100000:1.0F:1790972583.669298:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397632256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790972583.669391:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972583.669478:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397632256 00000100:00100000:1.0:1790972583.669486:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397632256 00000100:00100000:1.0:1790972583.669538:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790972583.669547:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397632256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790972583.669575:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790972583.669627:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397632256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972583.669633:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0F:1790972583.669743:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397632256:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0F:1790972583.669759:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790972584.165047:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972584.165089:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972584.165120:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972584.165149:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972584.165168:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972584.165186:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972584.165201:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972584.165217:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972584.165236:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972584.165261:0:19787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377643776 00000100:00100000:1.0:1790972584.165269:0:19787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377643776 00000100:00100000:1.0:1790972584.165322:0:19787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377644288 00000100:00100000:1.0:1790972584.165326:0:19787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377644288 00000100:00100000:1.0:1790972584.165339:0:19787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377643648 00000100:00100000:1.0:1790972584.165342:0:19787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377643648 00000100:00100000:1.0:1790972584.165352:0:19787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377644160 00000100:00100000:1.0:1790972584.165354:0:19787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377644160 00000100:00100000:1.0:1790972584.165370:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:1.0:1790972584.165380:0:19787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2398:x1877970377643776:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0F:1790972584.165447:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377643520 00000100:00100000:0.0:1790972584.165456:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377643520 00000100:00100000:1.0:1790972584.165457:0:19787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2398:x1877970377643776:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 79us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972584.165465:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:0.0:1790972584.165479:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377644032 00000100:00100000:1.0:1790972584.165482:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:0.0:1790972584.165482:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377644032 00000100:00100000:1.0:1790972584.165487:0:19787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2398:x1877970377644288:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972584.165492:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377643392 00000100:00100000:0.0:1790972584.165494:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377643392 00000100:00100000:0.0:1790972584.165504:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377643904 00000100:00100000:0.0:1790972584.165506:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377643904 00000100:00100000:1.0:1790972584.165512:0:19787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2398:x1877970377644288:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972584.165518:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:0.0:1790972584.165519:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 75 00000100:00100000:0.0:1790972584.165525:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2398:x1877970377643520:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1790972584.165529:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:1.0:1790972584.165534:0:19787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2398:x1877970377643648:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972584.165552:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2398:x1877970377643520:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972584.165553:0:19787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2398:x1877970377643648:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 18us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972584.165559:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:0.0:1790972584.165559:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 75 00000100:00100000:1.0:1790972584.165570:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:0.0:1790972584.165570:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:1.0:1790972584.165576:0:19787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2398:x1877970377644160:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972584.165576:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2398:x1877970377644032:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972584.165596:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2398:x1877970377644032:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 21us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972584.165602:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 76 00000100:00100000:0.0:1790972584.165613:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:0.0:1790972584.165619:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:756609d8-0e63-4567-bff3-21a421fa0eb0+22:2398:x1877970377643392:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1790972584.165635:0:17072:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377643264 00000100:00100000:3.0:1790972584.165639:0:17072:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377643264 00000100:00100000:3.0:1790972584.165687:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 170 00000100:00100000:3.0:1790972584.165694:0:17072:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07dfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5155986d-40a3-4b00-bd4e-464c33a61073+13:2398:x1877970377643264:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1790972584.165761:0:19787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2398:x1877970377644160:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 183us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972584.165767:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:1.0:1790972584.165790:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00100000:1.0:1790972584.165796:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ce7d447-3508-49e7-832d-5367b174a2f4+6:2398:x1877970377643904:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1790972584.165823:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ce7d447-3508-49e7-832d-5367b174a2f4+6:2398:x1877970377643904:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972584.165830:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 78 00000100:00080000:1.0:1790972584.165863:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790972584.165867:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790972584.165869:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790972584.165871:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790972584.166292:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:756609d8-0e63-4567-bff3-21a421fa0eb0+22:2398:x1877970377643392:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 671us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972584.166300:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 77 00000100:00100000:3.0:1790972584.167033:0:17072:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07dfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5155986d-40a3-4b00-bd4e-464c33a61073+13:2398:x1877970377643264:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 1334us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972584.167042:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 170 00010000:00010000:2.0:1790972584.564835:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790972585.140810:0:17114:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1790972585.140818:0:17114:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790972585.140837:0:17114:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1790972585.140846:0:17114:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790972585.206251:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5da60518-8817-4c86-8417-ee73ae6d3f86:3640:1877970397632384:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206343:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206411:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877970397632896:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206437:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206460:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f6c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877970397633408:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206482:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206498:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877970397633920:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206518:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206544:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790972585.206550:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397632512:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206573:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206592:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397633024:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206612:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206629:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f6c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877970397633536:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206685:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206715:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397632640:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206740:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206760:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397633152:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206780:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206797:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f6c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877970397633664:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206817:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206830:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1790972585.206835:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397632768:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206874:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206890:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f6c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397633280:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206909:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206925:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f6c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877970397633792:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.206944:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972585.206972:0:17075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397632384 00000100:00100000:2.0:1790972585.206980:0:17075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397632384 00000100:00100000:2.0:1790972585.207037:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790972585.207046:0:17075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5da60518-8817-4c86-8417-ee73ae6d3f86+24:3640:x1877970397632384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207096:0:17075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5da60518-8817-4c86-8417-ee73ae6d3f86+24:3640:x1877970397632384:12345-0@lo:400:kworker.0 Request processed in 51us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207102:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1790972585.207132:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397632896 00000100:00100000:2.0:1790972585.207136:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397632896 00000100:00100000:2.0:1790972585.207154:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397633408 00000100:00100000:2.0:1790972585.207157:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397633408 00000100:00100000:2.0:1790972585.207167:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397633920 00000100:00100000:2.0:1790972585.207169:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397633920 00000100:00100000:2.0:1790972585.207189:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397633536 00000100:00100000:2.0:1790972585.207192:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397633536 00000100:00100000:2.0:1790972585.207202:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397633664 00000100:00100000:2.0:1790972585.207204:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397633664 00000100:00100000:2.0:1790972585.207214:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397633792 00000100:00100000:2.0:1790972585.207216:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397633792 00000100:00100000:2.0:1790972585.207230:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790972585.207235:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877970397632896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207267:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877970397632896:12345-0@lo:400:kworker.0 Request processed in 33us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207283:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790972585.207297:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790972585.207301:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877970397633408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207330:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877970397633408:12345-0@lo:400:kworker.0 Request processed in 28us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207336:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790972585.207347:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790972585.207352:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877970397633920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207377:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877970397633920:12345-0@lo:400:kworker.0 Request processed in 25us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207383:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790972585.207393:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790972585.207399:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877970397633536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207424:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877970397633536:12345-0@lo:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207430:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790972585.207442:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790972585.207448:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877970397633664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207478:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877970397633664:12345-0@lo:400:kworker.0 Request processed in 31us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207484:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790972585.207494:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790972585.207500:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877970397633792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207525:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877970397633792:12345-0@lo:400:kworker.0 Request processed in 26us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207537:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790972585.207566:0:18145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397632512 00000100:00100000:2.0:1790972585.207569:0:18145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397632512 00000100:00100000:2.0:1790972585.207592:0:18145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397633024 00000100:00100000:2.0:1790972585.207595:0:18145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397633024 00000100:00100000:2.0:1790972585.207607:0:18145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790972585.207611:0:18145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397632512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207642:0:18145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397632512:12345-0@lo:400:kworker.0 Request processed in 30us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207648:0:18145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790972585.207658:0:18145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790972585.207686:0:18145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397633024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207711:0:18145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397633024:12345-0@lo:400:kworker.0 Request processed in 27us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207716:0:18145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790972585.207740:0:19787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397632640 00000100:00100000:2.0:1790972585.207744:0:19787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397632640 00000100:00100000:2.0:1790972585.207765:0:19787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397633152 00000100:00100000:2.0:1790972585.207768:0:19787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397633152 00000100:00100000:2.0:1790972585.207778:0:19787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397632768 00000100:00100000:2.0:1790972585.207780:0:19787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397632768 00000100:00100000:2.0:1790972585.207790:0:19787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397633280 00000100:00100000:2.0:1790972585.207792:0:19787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397633280 00000100:00100000:2.0:1790972585.207804:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790972585.207809:0:19787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397632640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207837:0:19787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397632640:12345-0@lo:400:kworker.0 Request processed in 28us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207843:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790972585.207862:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790972585.207867:0:19787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397633152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207897:0:19787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397633152:12345-0@lo:400:kworker.0 Request processed in 30us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207903:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790972585.207912:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790972585.207918:0:19787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397632768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207941:0:19787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397632768:12345-0@lo:400:kworker.0 Request processed in 24us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207946:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790972585.207956:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790972585.207961:0:19787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397633280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.207984:0:19787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397633280:12345-0@lo:400:kworker.0 Request processed in 23us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972585.207988:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1790972585.208029:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790972585.208033:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790972585.208036:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790972585.208038:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790972585.208151:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1790972585.208157:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff888d088e7800, transno 8589934596 00000004:00080000:2.0:1790972585.208177:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1790972585.208199:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d570000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397632768:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.208213:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f6c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397633280:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.208222:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f6c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877970397633792:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.208230:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397632640:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.208250:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07b84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397633152:0@lo:400:kworker.0 00010000:00080000:2.0:1790972585.208262:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3f6c5c00 x1877970397633664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972585.208271:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f6c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877970397633664:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.208305:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397632512:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.208314:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397633024:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.208324:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f6c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877970397633536:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.208332:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d572a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5da60518-8817-4c86-8417-ee73ae6d3f86:3640:1877970397632384:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.208340:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877970397632896:0@lo:400:kworker.0 00000100:00100000:2.0:1790972585.208348:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f6c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877970397633408:0@lo:400:kworker.0 00010000:00080000:2.0:1790972585.208357:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888d07c6ea00 x1877970397633920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972585.208366:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07c6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877970397633920:0@lo:400:kworker.0 00000100:00100000:0.0:1790972585.208608:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397634048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790972585.208647:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972585.209303:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397634048 00000100:00100000:1.0:1790972585.209310:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397634048 00000100:00100000:1.0:1790972585.209446:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790972585.209455:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397634048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790972585.209480:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790972585.209527:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397634048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972585.209533:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790972585.209578:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f777100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397634048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790972585.210528:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790972585.210543:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397634176:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790972585.210593:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972585.210628:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397634176 00000100:00100000:3.0:1790972585.210633:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397634176 00000100:00100000:3.0:1790972585.210695:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790972585.210703:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397634176:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790972585.210720:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790972585.210757:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397634176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972585.210764:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790972585.210805:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07c5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397634176:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1790972585.222411:0:17060:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1790972585.222438:0:17060:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff888e39449240 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:1.0:1790972585.222443:0:17060:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff888e3da66100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff888e39449f00 00000020:00080000:1.0:1790972585.222447:0:17060:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff888e3da66d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff888d010c7c00 00010000:00010000:1.0:1790972585.222504:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff888e09feaa00/0xd61f4faa13a117d6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972585.222517:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e09feaa00/0xd61f4faa13a117d6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972585.222534:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e09feaa00/0xd61f4faa13a117d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972585.222542:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e09feaa00 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:1.0:1790972585.222548:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e09feaa00/0xd61f4faa13a117d6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972585.222558:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e09feaa00/0xd61f4faa13a117d6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972585.222581:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff888e163e4000) 00010000:00010000:1.0:1790972585.222585:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790972585.222591:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e09feaa00/0xd61f4faa13a117d6 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972585.222597:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e09feaa00/0xd61f4faa13a117d6 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17079 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1790972585.222705:0:17119:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:1.0:1790972585.222791:0:17119:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1790972585.594691:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972585.722080:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397634304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790972585.722152:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972585.731174:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397634304 00000100:00100000:3.0:1790972585.731191:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397634304 00000100:00100000:3.0:1790972585.731751:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790972585.731763:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397634304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790972585.731805:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790972585.731886:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397634304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (9733us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972585.731893:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790972585.739200:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07d7c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397634304:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790972586.583555:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972586.587144:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377644416 00000100:00100000:3.0:1790972586.587160:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377644416 00000100:00100000:3.0:1790972586.587306:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00100000:3.0:1790972586.587317:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:756609d8-0e63-4567-bff3-21a421fa0eb0+13:15532:x1877970377644416:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790972586.587428:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:756609d8-0e63-4567-bff3-21a421fa0eb0+13:15532:x1877970377644416:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 Request processed in 113us (3882us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972586.587436:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 65 00000100:00080000:2.0:1790972586.587569:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790972586.596613:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972586.596729:0:18547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377644544 00000100:00100000:3.0:1790972586.596739:0:18547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377644544 00000100:00100000:3.0:1790972586.596815:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00100000:3.0:1790972586.596826:0:18547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:756609d8-0e63-4567-bff3-21a421fa0eb0+5:15532:x1877970377644544:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1790972586.596920:0:18547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:756609d8-0e63-4567-bff3-21a421fa0eb0+5:15532:x1877970377644544:12345-192.168.203.39@tcp:60:lhsmtool_posix.0 Request processed in 97us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972586.596928:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 66 00000100:00080000:2.0:1790972586.597094:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790972586.601011:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972586.601099:0:17083:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377644800 00000100:00100000:2.0:1790972586.601109:0:17083:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377644800 00000100:00100000:2.0:1790972586.601173:0:17083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:2.0:1790972586.601182:0:17083:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:756609d8-0e63-4567-bff3-21a421fa0eb0+13:15532:x1877970377644800:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790972586.601411:0:17083:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:756609d8-0e63-4567-bff3-21a421fa0eb0+14:15532:x1877970377644800:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 229us (419us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1790972586.601430:0:17083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000040:00080000:1.0:1790972586.614223:0:17831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790972586.614825:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972586.743063:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397634432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790972586.743133:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972586.743182:0:18145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397634432 00000100:00100000:2.0:1790972586.743190:0:18145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397634432 00000100:00100000:2.0:1790972586.743228:0:18145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790972586.743235:0:18145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397634432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790972586.743267:0:18145:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790972586.743306:0:18145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397634432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972586.743312:0:18145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790972586.743353:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397634432:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790972586.743550:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790972586.743557:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397634560:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790972586.743581:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972586.743605:0:17086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397634560 00000100:00100000:2.0:1790972586.743609:0:17086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397634560 00000100:00100000:2.0:1790972586.743630:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790972586.743635:0:17086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397634560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790972586.743654:0:17086:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1790972586.743819:0:17086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397634560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 182us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972586.743826:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790972586.754757:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397634560:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1790972587.637076:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972588.663295:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790972588.692422:0:20455:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 16:23:07 (1790972587) 00000100:00100000:1.0:1790972588.791439:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397634688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790972588.791521:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972588.791657:0:18589:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397634688 00000100:00100000:2.0:1790972588.791690:0:18589:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397634688 00000100:00100000:2.0:1790972588.791745:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790972588.791754:0:18589:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397634688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790972588.791782:0:18589:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790972588.791833:0:18589:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397634688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972588.791840:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1790972588.791861:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790972588.793236:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07c6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397634688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790972589.286361:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972589.286406:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972589.286441:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972589.286470:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972589.286489:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972589.286506:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972589.286524:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972589.286547:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377645184 00000100:00100000:3.0:1790972589.286557:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377645184 00000100:00100000:3.0:1790972589.286603:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377645056 00000100:00100000:3.0:1790972589.286607:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377645056 00000100:00100000:3.0:1790972589.286620:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377645568 00000100:00100000:3.0:1790972589.286622:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377645568 00000100:00100000:3.0:1790972589.286646:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377645696 00000100:00100000:3.0:1790972589.286649:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377645696 00000100:00100000:3.0:1790972589.286693:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 85 00000100:00100000:3.0:1790972589.286704:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2399:x1877970377645184:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1790972589.286777:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2399:x1877970377645184:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 75us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972589.286784:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 85 00000100:00100000:3.0:1790972589.286801:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:3.0:1790972589.286808:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:756609d8-0e63-4567-bff3-21a421fa0eb0+14:2399:x1877970377645056:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1790972589.286839:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:756609d8-0e63-4567-bff3-21a421fa0eb0+14:2399:x1877970377645056:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 32us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972589.286845:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 86 00000100:00100000:3.0:1790972589.286855:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:3.0:1790972589.286861:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ce7d447-3508-49e7-832d-5367b174a2f4+6:2398:x1877970377645568:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1790972589.286885:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ce7d447-3508-49e7-832d-5367b174a2f4+6:2398:x1877970377645568:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972589.286891:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 87 00000100:00100000:3.0:1790972589.286911:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:3.0:1790972589.286917:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2398:x1877970377645696:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1790972589.286942:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2398:x1877970377645696:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972589.286948:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 88 00000100:00100000:3.0:1790972589.286966:0:18586:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377645312 00000100:00100000:3.0:1790972589.286969:0:18586:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377645312 00000100:00100000:3.0:1790972589.287008:0:18586:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377645440 00000100:00100000:3.0:1790972589.287012:0:18586:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377645440 00000100:00100000:0.0:1790972589.287104:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:0.0:1790972589.287115:0:19787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2398:x1877970377645440:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972589.287152:0:19787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2398:x1877970377645440:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 41us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972589.287158:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:0.0:1790972589.287173:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:0.0:1790972589.287179:0:19787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2395:x1877970377645312:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:0.0:1790972589.287196:0:19787:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11505 00000100:00080000:0.0:1790972589.287211:0:19787:0:(import.c:65:import_set_state_nolock()) ffff888e26a1a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790972589.287251:0:19787:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1790972589.287364:0:19787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:756609d8-0e63-4567-bff3-21a421fa0eb0+2:2395:x1877970377645312:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 184us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972589.287371:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00010000:00010000:0.0:1790972589.287423:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790972589.287616:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790972589.287620:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790972589.287622:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790972589.287624:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790972589.288233:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972589.288257:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972589.288281:0:18585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377645824 00000100:00100000:3.0:1790972589.288287:0:18585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377645824 00000100:00100000:3.0:1790972589.288322:0:18585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377645952 00000100:00100000:3.0:1790972589.288325:0:18585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377645952 00000100:00100000:3.0:1790972589.288342:0:18585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:3.0:1790972589.288348:0:18585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2395:x1877970377645824:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:3.0:1790972589.288372:0:18585:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11544 00000100:00080000:3.0:1790972589.288381:0:18585:0:(import.c:65:import_set_state_nolock()) ffff888e02881000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790972589.288418:0:18585:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1790972589.288522:0:18585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ce7d447-3508-49e7-832d-5367b174a2f4+2:2395:x1877970377645824:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 173us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972589.288528:0:18585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:3.0:1790972589.288542:0:18585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:3.0:1790972589.288558:0:18585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2395:x1877970377645952:12345-192.168.203.39@tcp:9:kworker.0 00000020:00000080:3.0:1790972589.288570:0:18585:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1154b 00000100:00080000:3.0:1790972589.288577:0:18585:0:(import.c:65:import_set_state_nolock()) ffff888e3fa26800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790972589.288599:0:18585:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1790972589.290273:0:17072:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377644928 00000100:00100000:1.0:1790972589.290287:0:17072:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377644928 00000100:00100000:1.0:1790972589.290350:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 172 00000100:00100000:1.0:1790972589.290370:0:17072:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07dfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5155986d-40a3-4b00-bd4e-464c33a61073+13:2399:x1877970377644928:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1790972589.290442:0:17072:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07dfe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5155986d-40a3-4b00-bd4e-464c33a61073+13:2399:x1877970377644928:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 73us (4092us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972589.290450:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 172 00010000:00010000:1.0:1790972589.290496:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972589.291349:0:18585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7ce7d447-3508-49e7-832d-5367b174a2f4+2:2395:x1877970377645952:12345-192.168.203.39@tcp:9:kworker.0 Request processed in 2786us (3085us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972589.291359:0:18585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00080000:3.0:1790972589.291389:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790972589.291394:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790972589.291401:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972589.685698:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972590.325606:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397634944:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.325711:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.325759:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397635456:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.325779:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.325796:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877970397635968:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.325817:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.325846:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790972590.325852:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397635072:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.325878:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.325896:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397635584:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.325918:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.325937:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877970397636096:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.325956:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.326000:0:17086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397634944 00000100:00100000:2.0:1790972590.326008:0:17086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397634944 00000100:00100000:2.0:1790972590.326048:0:17086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397635456 00000100:00100000:2.0:1790972590.326064:0:17086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397635456 00000100:00100000:2.0:1790972590.326085:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790972590.326093:0:17086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397634944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.326143:0:17086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397634944:12345-0@lo:400:kworker.0 Request processed in 50us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.326150:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790972590.326209:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790972590.326219:0:17085:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397635456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972590.326255:0:17085:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397635456:12345-0@lo:400:kworker.0 Request processed in 39us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972590.326261:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790972590.326620:0:19023:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397635072 00000100:00100000:2.0:1790972590.326626:0:19023:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397635072 00000100:00100000:2.0:1790972590.326703:0:19023:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397635584 00000100:00100000:2.0:1790972590.326706:0:19023:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397635584 00000100:00100000:2.0:1790972590.326730:0:19023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790972590.326736:0:19023:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397635072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.326772:0:19023:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07b84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397635072:12345-0@lo:400:kworker.0 Request processed in 36us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.326778:0:19023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790972590.326789:0:19023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790972590.326795:0:19023:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f6c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397635584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.326822:0:19023:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f6c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397635584:12345-0@lo:400:kworker.0 Request processed in 27us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.326828:0:19023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790972590.326849:0:18547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397635968 00000100:00100000:2.0:1790972590.326853:0:18547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397635968 00000100:00100000:2.0:1790972590.326881:0:18547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397636096 00000100:00100000:2.0:1790972590.326884:0:18547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397636096 00000100:00100000:2.0:1790972590.326903:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790972590.326910:0:18547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877970397635968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.326940:0:18547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877970397635968:12345-0@lo:400:kworker.0 Request processed in 31us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.326960:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790972590.326988:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790972590.326995:0:18547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f6c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877970397636096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.327026:0:18547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f6c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877970397636096:12345-0@lo:400:kworker.0 Request processed in 32us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.327032:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1790972590.327084:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397635072:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.327096:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397635584:0@lo:400:kworker.0 00010000:00080000:2.0:1790972590.327119:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e08b81c00 x1877970397636096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972590.327130:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877970397636096:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.327143:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397634944:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.327152:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397635456:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.327161:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877970397635968:0@lo:400:kworker.0 00000100:00080000:1.0:1790972590.327526:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790972590.327531:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790972590.327534:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790972590.336749:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5da60518-8817-4c86-8417-ee73ae6d3f86:3639:1877970397634816:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.336827:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.336872:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877970397635328:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.336912:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.336934:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877970397635840:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.336957:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.336986:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877970397636352:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337025:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.337052:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1790972590.337060:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397635200:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337082:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.337106:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397635712:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337137:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.337154:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877970397636224:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337172:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.337231:0:17074:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397634816 00000100:00100000:2.0:1790972590.337239:0:17074:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397634816 00000100:00100000:2.0:1790972590.337283:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790972590.337290:0:17074:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5da60518-8817-4c86-8417-ee73ae6d3f86+24:3639:x1877970397634816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337339:0:17074:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d546c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5da60518-8817-4c86-8417-ee73ae6d3f86+24:3639:x1877970397634816:12345-0@lo:400:kworker.0 Request processed in 49us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.337347:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1790972590.337380:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397635328 00000100:00100000:2.0:1790972590.337384:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397635328 00000100:00100000:2.0:1790972590.337401:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397635840 00000100:00100000:2.0:1790972590.337404:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397635840 00000100:00100000:2.0:1790972590.337414:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397636352 00000100:00100000:2.0:1790972590.337416:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397636352 00000100:00100000:2.0:1790972590.337437:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397636224 00000100:00100000:2.0:1790972590.337440:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397636224 00000100:00100000:2.0:1790972590.337452:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790972590.337458:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f6c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877970397635328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337489:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f6c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877970397635328:12345-0@lo:400:kworker.0 Request processed in 31us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.337505:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790972590.337517:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790972590.337522:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f6c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877970397635840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337550:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f6c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877970397635840:12345-0@lo:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.337555:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1790972590.337566:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790972590.337572:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e08b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877970397636352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337598:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e08b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3639:x1877970397636352:12345-0@lo:400:kworker.0 Request processed in 27us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.337604:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1790972590.337614:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1790972590.337619:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e08b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877970397636224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337642:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e08b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877970397636224:12345-0@lo:400:kworker.0 Request processed in 23us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.337647:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:2.0:1790972590.337683:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790972590.337687:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790972590.337703:0:19023:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397635200 00000100:00100000:2.0:1790972590.337707:0:19023:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397635200 00000100:00100000:2.0:1790972590.337731:0:19023:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397635712 00000100:00100000:2.0:1790972590.337734:0:19023:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397635712 00000100:00100000:2.0:1790972590.337749:0:19023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790972590.337755:0:19023:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e08b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397635200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337785:0:19023:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e08b82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397635200:12345-0@lo:400:kworker.0 Request processed in 30us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.337801:0:19023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790972590.337813:0:19023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790972590.337819:0:19023:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e08b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397635712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337847:0:19023:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e08b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397635712:12345-0@lo:400:kworker.0 Request processed in 29us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.337852:0:19023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1790972590.337872:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790972590.337899:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397635200:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337909:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397635712:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337919:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877970397636224:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337927:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5da60518-8817-4c86-8417-ee73ae6d3f86:3639:1877970397634816:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337936:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877970397635328:0@lo:400:kworker.0 00000100:00100000:2.0:1790972590.337946:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877970397635840:0@lo:400:kworker.0 00010000:00080000:2.0:1790972590.337958:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888d08897800 x1877970397636352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972590.337979:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877970397636352:0@lo:400:kworker.0 00000100:00100000:0.0:1790972590.340471:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397636608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790972590.340544:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972590.340599:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790972590.340607:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f6c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397636480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790972590.340632:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972590.342441:0:18589:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397636608 00000100:00100000:2.0:1790972590.342455:0:18589:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397636608 00000100:00100000:2.0:1790972590.342499:0:18589:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397636480 00000100:00100000:2.0:1790972590.342501:0:18589:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397636480 00000100:00100000:2.0:1790972590.342516:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790972590.342525:0:18589:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397636608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790972590.342572:0:18589:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790972590.342651:0:18589:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397636608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.342659:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790972590.346014:0:18589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790972590.346031:0:18589:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397636480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790972590.346064:0:18589:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790972590.346139:0:18589:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f777100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397636480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 115us (5504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972590.346147:0:18589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790972590.346193:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397636608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790972590.346225:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f6c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397636480:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1790972590.709100:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972590.849303:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790972590.849325:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397636736:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1790972590.849393:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972590.849440:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397636736 00000100:00100000:3.0:1790972590.849447:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397636736 00000100:00100000:3.0:1790972590.849497:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790972590.849506:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397636736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790972590.849536:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790972590.849579:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397636736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972590.849585:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790972590.849624:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397636736:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1790972590.855528:0:17060:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1790972590.855546:0:17060:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:3.0:1790972590.855858:0:17119:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:3.0:1790972590.855887:0:17119:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:3.0:1790972591.733175:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972591.860937:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397636992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790972591.861027:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972591.861066:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397636864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790972591.861087:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972591.861219:0:17086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397636992 00000100:00100000:2.0:1790972591.861227:0:17086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397636992 00000100:00100000:2.0:1790972591.861274:0:17086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397636864 00000100:00100000:2.0:1790972591.861277:0:17086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397636864 00000100:00100000:2.0:1790972591.861293:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790972591.861300:0:17086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397636992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790972591.861331:0:17086:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1790972591.861378:0:17086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397636992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972591.861386:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790972591.861401:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790972591.861407:0:17086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397636864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790972591.861422:0:17086:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790972591.861446:0:17086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397636864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 39us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972591.861452:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790972591.861543:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397636992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790972591.861556:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397636864:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790972592.757791:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972592.927818:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972592.928020:0:17084:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377646208 00000100:00100000:1.0:1790972592.928031:0:17084:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377646208 00000100:00100000:1.0:1790972592.928114:0:17084:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:1.0:1790972592.928126:0:17084:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:756609d8-0e63-4567-bff3-21a421fa0eb0+13:16287:x1877970377646208:12345-192.168.203.39@tcp:35:umount.0 00000001:00080000:1.0:1790972592.928367:0:17084:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1790972592.928453:0:17084:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00080000:2.0:1790972592.928638:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790972592.929735:0:17084:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f777b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:756609d8-0e63-4567-bff3-21a421fa0eb0+16:16287:x1877970377646208:12345-192.168.203.39@tcp:35:umount.0 Request processed in 1605us (1918us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1790972592.929748:0:17084:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000020:00080000:1.0:1790972592.929755:0:17084:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1790972592.942870:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972592.942931:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972592.942981:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972592.943023:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377646336 00000100:00100000:0.0:1790972592.943035:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377646336 00000100:00100000:0.0:1790972592.943097:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377646464 00000100:00100000:0.0:1790972592.943101:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377646464 00000100:00100000:0.0:1790972592.943114:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377646720 00000100:00100000:0.0:1790972592.943117:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377646720 00000100:00100000:0.0:1790972592.943133:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:0.0:1790972592.943142:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08896300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5155986d-40a3-4b00-bd4e-464c33a61073+15:2397:x1877970377646336:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790972592.943166:0:17065:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972592.943185:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3d3cdc00/0xd61f4faa13a114e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1b7a expref: 15 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972592.943201:0:17065:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790972592.943261:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08896300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5155986d-40a3-4b00-bd4e-464c33a61073+14:2397:x1877970377646336:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 118us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972592.943267:0:20106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:0.0:1790972592.943277:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:2.0:1790972592.943283:0:20106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08894e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5155986d-40a3-4b00-bd4e-464c33a61073+14:2397:x1877970377646464:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790972592.943294:0:20106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790972592.943302:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00010000:00010000:2.0:1790972592.943308:0:20106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e0dfd7200/0xd61f4faa13a114e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1bab expref: 13 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972592.943314:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5155986d-40a3-4b00-bd4e-464c33a61073+13:2396:x1877970377646720:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790972592.943327:0:20106:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790972592.943329:0:17065:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972592.943342:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdc000/0xd61f4faa13a1156e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1c61 expref: 12 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972592.943352:0:17065:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790972592.943355:0:20106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08894e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5155986d-40a3-4b00-bd4e-464c33a61073+11:2397:x1877970377646464:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 76us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972592.943364:0:20106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:0.0:1790972592.943382:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5155986d-40a3-4b00-bd4e-464c33a61073+10:2396:x1877970377646720:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 70us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972592.943389:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:3.0:1790972592.947760:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972592.947868:0:18586:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377646592 00000100:00100000:2.0:1790972592.947880:0:18586:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377646592 00000100:00100000:2.0:1790972592.947969:0:18586:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:2.0:1790972592.947980:0:18586:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2395:x1877970377646592:12345-192.168.203.39@tcp:9:umount.0 00000100:00080000:0.0:1790972592.947994:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:2.0:1790972592.948036:0:18586:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1150c 00000100:00080000:2.0:1790972592.948046:0:18586:0:(import.c:65:import_set_state_nolock()) ffff888e3d4ba800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790972592.948089:0:18586:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1790972592.948238:0:18586:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:756609d8-0e63-4567-bff3-21a421fa0eb0+2:2395:x1877970377646592:12345-192.168.203.39@tcp:9:umount.0 Request processed in 259us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972592.948246:0:18586:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00010000:00010000:1.0:1790972592.948579:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972592.959967:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972592.960128:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377647616 00000100:00100000:0.0:1790972592.960139:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377647616 00000100:00100000:0.0:1790972592.960198:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 67 00000100:00100000:0.0:1790972592.960207:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e08b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:756609d8-0e63-4567-bff3-21a421fa0eb0+16:2395:x1877970377647616:12345-192.168.203.39@tcp:39:umount.0 00000020:00000080:0.0:1790972592.960241:0:17079:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a114f7 00000020:00010000:0.0:1790972592.960256:0:17079:0:(genops.c:1920:obd_stale_export_put()) Put export ffff888d07d68000: total 0 00000100:00080000:0.0:1790972592.960260:0:17079:0:(import.c:65:import_set_state_nolock()) ffff888d07d6a800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790972592.960297:0:17079:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000020:00010000:3.0:1790972592.960339:0:20105:0:(genops.c:1906:obd_stale_export_get()) Get export ffff888d07d68000: total 0 00010000:00010000:3.0:1790972592.960345:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972592.960403:0:20105:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff888d07d68000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1790972592.960445:0:20105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff888e163e4e00) 00010000:00010000:3.0:1790972592.960449:0:20105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790972592.960458:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e0dfd7a00/0xd61f4faa13a11751 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ce6 expref: 15 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972592.960492:0:20105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff888e09fe0d00) 00010000:00010000:3.0:1790972592.960495:0:20105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790972592.960500:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e0dfd7000/0xd61f4faa13a115de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1c6f expref: 14 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972592.960521:0:20105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff888e163e4e00) 00010000:00010000:3.0:1790972592.960524:0:20105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790972592.960528:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e0dfd6200/0xd61f4faa13a11720 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1cd1 expref: 13 pid: 17080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972592.960723:0:20105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888e09fe0700) 00000100:00100000:0.0:1790972592.960723:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e08b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:756609d8-0e63-4567-bff3-21a421fa0eb0+12:2395:x1877970377647616:12345-192.168.203.39@tcp:39:umount.0 Request processed in 514us (770us total) trans 8589934627 rc 0/0 00010000:00010000:3.0:1790972592.960728:0:20105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790972592.960737:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e0dfd7c00/0xd61f4faa13a1161d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1c7d expref: 12 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972592.960741:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 67 00010000:00010000:3.0:1790972592.960761:0:20105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff888e163e4000) 00010000:00010000:3.0:1790972592.960764:0:20105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790972592.960769:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3d3cde00/0xd61f4faa13a117ac lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1cfb expref: 10 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972592.960792:0:20105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff888e163e4e00) 00010000:00010000:3.0:1790972592.960795:0:20105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790972592.960799:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11800 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d17 expref: 9 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972592.960829:0:20105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff888e163e4900) 00010000:00010000:3.0:1790972592.960831:0:20105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790972592.960835:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3d3cca00/0xd61f4faa13a115c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1c68 expref: 8 pid: 18547 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972592.960851:0:20105:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff888e09fe0600) 00010000:00010000:3.0:1790972592.960853:0:20105:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790972592.960857:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3d3cc400/0xd61f4faa13a116a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ca7 expref: 7 pid: 17081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972592.961144:0:20105:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff888d07d68000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1790972592.961164:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972592.961172:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972592.961174:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972592.977607:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972592.977761:0:18547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377647744 00000100:00100000:2.0:1790972592.977771:0:18547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377647744 00000100:00100000:2.0:1790972592.977842:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00100000:2.0:1790972592.977852:0:18547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:756609d8-0e63-4567-bff3-21a421fa0eb0+5:2395:x1877970377647744:12345-192.168.203.39@tcp:39:umount.0 00000020:00000080:2.0:1790972592.977925:0:18547:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a114fe 00000100:00080000:2.0:1790972592.977943:0:18547:0:(import.c:65:import_set_state_nolock()) ffff888e3a755800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790972592.977986:0:18547:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1790972592.978215:0:18547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:756609d8-0e63-4567-bff3-21a421fa0eb0+3:2395:x1877970377647744:12345-192.168.203.39@tcp:39:umount.0 Request processed in 364us (618us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790972592.978223:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 68 00000100:00080000:0.0:1790972592.978482:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1790972592.979361:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972593.781216:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790972593.908898:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397637120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790972593.908986:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972593.909195:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397637120 00000100:00100000:3.0:1790972593.909203:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397637120 00000100:00100000:3.0:1790972593.909268:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790972593.909279:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397637120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790972593.909308:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790972593.909364:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397637120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972593.909371:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1790972593.909530:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790972593.909600:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397637120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790972594.408428:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972594.408474:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972594.408502:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972594.408581:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377648128 00000100:00100000:3.0:1790972594.408591:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377648128 00000100:00100000:3.0:1790972594.408656:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377648000 00000100:00100000:3.0:1790972594.408685:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377648000 00000100:00100000:3.0:1790972594.408712:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 95 00000100:00100000:3.0:1790972594.408721:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2399:x1877970377648128:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1790972594.408815:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2399:x1877970377648128:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 94us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972594.408822:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 95 00000100:00100000:3.0:1790972594.408840:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00100000:3.0:1790972594.408846:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ce7d447-3508-49e7-832d-5367b174a2f4+6:2399:x1877970377648000:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1790972594.408870:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ce7d447-3508-49e7-832d-5367b174a2f4+6:2399:x1877970377648000:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972594.408875:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 96 00000100:00080000:1.0:1790972594.409087:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790972594.409092:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790972594.410267:0:17075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377647872 00000100:00100000:0.0:1790972594.410279:0:17075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377647872 00000100:00100000:0.0:1790972594.410337:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 174 00000100:00100000:0.0:1790972594.410346:0:17075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5155986d-40a3-4b00-bd4e-464c33a61073+10:2399:x1877970377647872:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972594.410397:0:17075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d547c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5155986d-40a3-4b00-bd4e-464c33a61073+10:2399:x1877970377647872:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 53us (1978us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972594.410404:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 174 00010000:00010000:3.0:1790972594.804994:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972594.855634:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972594.855827:0:20106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377648256 00000100:00100000:3.0:1790972594.855838:0:20106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377648256 00000100:00100000:3.0:1790972594.855918:0:20106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:3.0:1790972594.855928:0:20106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e08b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5155986d-40a3-4b00-bd4e-464c33a61073+10:2396:x1877970377648256:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790972594.855952:0:20106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790972594.855974:0:20106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e0dfd6600/0xd61f4faa13a11521 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1bea expref: 10 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972594.855992:0:20106:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790972594.856058:0:20106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e08b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5155986d-40a3-4b00-bd4e-464c33a61073+9:2396:x1877970377648256:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 132us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972594.856066:0:20106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:0.0:1790972594.856571:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972594.856617:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972594.856731:0:17067:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377648384 00000100:00100000:3.0:1790972594.856738:0:17067:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377648384 00000100:00100000:3.0:1790972594.857082:0:17067:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377648512 00000100:00100000:3.0:1790972594.857087:0:17067:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377648512 00000100:00100000:3.0:1790972594.857154:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:3.0:1790972594.857163:0:17067:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5155986d-40a3-4b00-bd4e-464c33a61073+10:2397:x1877970377648384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790972594.857174:0:17067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790972594.857188:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11528 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1c1b expref: 10 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972594.857202:0:17067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790972594.857251:0:17067:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5155986d-40a3-4b00-bd4e-464c33a61073+9:2397:x1877970377648384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 90us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972594.857258:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:3.0:1790972594.857272:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:3.0:1790972594.857278:0:17067:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5155986d-40a3-4b00-bd4e-464c33a61073+8:2397:x1877970377648512:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790972594.857286:0:17067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790972594.857303:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e0dfd7600/0xd61f4faa13a11567 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1c5a expref: 8 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972594.857322:0:17067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790972594.857342:0:17067:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5155986d-40a3-4b00-bd4e-464c33a61073+7:2397:x1877970377648512:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 64us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972594.857349:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:1.0:1790972594.867058:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972594.867907:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377648768 00000100:00100000:3.0:1790972594.867918:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377648768 00000100:00100000:3.0:1790972594.867993:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 69 00000100:00100000:3.0:1790972594.868004:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ce7d447-3508-49e7-832d-5367b174a2f4+6:2395:x1877970377648768:12345-192.168.203.39@tcp:39:umount.0 00000020:00000080:3.0:1790972594.868047:0:17079:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11536 00000020:00010000:3.0:1790972594.868057:0:17079:0:(genops.c:1920:obd_stale_export_put()) Put export ffff888e1f7ed800: total 0 00000100:00080000:3.0:1790972594.868061:0:17079:0:(import.c:65:import_set_state_nolock()) ffff888e1f7ee800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790972594.868094:0:17079:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00010000:1.0:1790972594.868152:0:17068:0:(genops.c:1906:obd_stale_export_get()) Get export ffff888e1f7ed800: total 0 00010000:00010000:1.0:1790972594.868208:0:17068:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff888e1f7ed800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1790972594.868240:0:17068:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888e09fe0700) 00010000:00010000:1.0:1790972594.868244:0:17068:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790972594.868252:0:17068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e0dfd6800/0xd61f4faa13a1162b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1c84 expref: 5 pid: 17079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972594.868268:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7ce7d447-3508-49e7-832d-5367b174a2f4+4:2395:x1877970377648768:12345-192.168.203.39@tcp:39:umount.0 Request processed in 261us (1214us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1790972594.868275:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 69 00010000:00010000:1.0:1790972594.868276:0:17068:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff888e1f7ed800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1790972594.868288:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972594.868290:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972594.868292:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972594.886254:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972594.886350:0:18547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377648896 00000100:00100000:3.0:1790972594.886360:0:18547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377648896 00000100:00100000:3.0:1790972594.886421:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 70 00000100:00100000:3.0:1790972594.886431:0:18547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ce7d447-3508-49e7-832d-5367b174a2f4+5:2395:x1877970377648896:12345-192.168.203.39@tcp:39:umount.0 00000020:00000080:3.0:1790972594.886474:0:18547:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1153d 00000100:00080000:3.0:1790972594.886485:0:18547:0:(import.c:65:import_set_state_nolock()) ffff888d05dfe800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790972594.886516:0:18547:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:1.0:1790972594.886709:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972594.886861:0:18547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7ce7d447-3508-49e7-832d-5367b174a2f4+3:2395:x1877970377648896:12345-192.168.203.39@tcp:39:umount.0 Request processed in 431us (616us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790972594.886880:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 70 00000001:00100000:2.0:1790972594.942597:0:19400:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 756609d8-0e63-4567-bff3-21a421fa0eb0 00000001:00100000:0.0:1790972594.942597:0:18581:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7ce7d447-3508-49e7-832d-5367b174a2f4 00000020:00000080:2.0:1790972594.942609:0:19400:0:(genops.c:885:class_export_put()) final put ffff888e26a1f000/756609d8-0e63-4567-bff3-21a421fa0eb0 00000020:00000080:0.0:1790972594.942610:0:18581:0:(genops.c:885:class_export_put()) final put ffff888d05def800/7ce7d447-3508-49e7-832d-5367b174a2f4 00000001:00100000:2.0:1790972594.942639:0:19400:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7ce7d447-3508-49e7-832d-5367b174a2f4 00000020:00000080:2.0:1790972594.942643:0:19400:0:(genops.c:885:class_export_put()) final put ffff888e3fa25800/7ce7d447-3508-49e7-832d-5367b174a2f4 00000001:00100000:0.0:1790972594.942643:0:18581:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 756609d8-0e63-4567-bff3-21a421fa0eb0 00000020:00000080:0.0:1790972594.942648:0:18581:0:(genops.c:885:class_export_put()) final put ffff888d07d04800/756609d8-0e63-4567-bff3-21a421fa0eb0 00000020:00000080:1.0:1790972594.942946:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e26a1f000/756609d8-0e63-4567-bff3-21a421fa0eb0 for lustre-OST0001 00000020:00000080:1.0:1790972594.943002:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888d05def800/7ce7d447-3508-49e7-832d-5367b174a2f4 for lustre-OST0000 00000020:00000080:1.0:1790972594.943042:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3fa25800/7ce7d447-3508-49e7-832d-5367b174a2f4 for lustre-OST0001 00000020:00000080:1.0:1790972594.943182:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888d07d04800/756609d8-0e63-4567-bff3-21a421fa0eb0 for lustre-OST0000 00000020:00000080:1.0:1790972594.943209:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e3d4ba800 for lustre-OST0001 00000020:00000080:1.0:1790972594.943215:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e02881000 for lustre-OST0000 00000020:00000080:1.0:1790972594.943218:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e3fa26800 for lustre-OST0001 00000020:00000080:1.0:1790972594.943222:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e26a1a800 for lustre-OST0000 00000100:00100000:2.0:1790972594.948503:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972594.950361:0:17072:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377649152 00000100:00100000:1.0:1790972594.950375:0:17072:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377649152 00000100:00100000:1.0:1790972594.950434:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 175 00000100:00100000:1.0:1790972594.950443:0:17072:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5155986d-40a3-4b00-bd4e-464c33a61073+7:2395:x1877970377649152:12345-192.168.203.39@tcp:251:umount.0 00000020:00000080:1.0:1790972594.950488:0:17072:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a114d4 00000020:00010000:1.0:1790972594.950496:0:17072:0:(genops.c:1920:obd_stale_export_put()) Put export ffff888d07d6b800: total 0 00000100:00080000:1.0:1790972594.950500:0:17072:0:(import.c:65:import_set_state_nolock()) ffff888d07d6b000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790972594.950588:0:17072:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d546850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5155986d-40a3-4b00-bd4e-464c33a61073+3:2395:x1877970377649152:12345-192.168.203.39@tcp:251:umount.0 Request processed in 145us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972594.950595:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 175 00000020:00010000:3.0:1790972594.950812:0:20105:0:(genops.c:1906:obd_stale_export_get()) Get export ffff888d07d6b800: total 0 00010000:00010000:3.0:1790972594.950873:0:20105:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff888d07d6b800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790972594.950915:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3d3cd600/0xd61f4faa13a114db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1b73 expref: 2 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972594.950930:0:20105:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff888d07d6b800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1790972594.950949:0:20105:0:(genops.c:885:class_export_put()) final put ffff888d07d6b800/5155986d-40a3-4b00-bd4e-464c33a61073 00010000:00010000:3.0:1790972594.950966:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972594.950968:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972594.950970:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790972594.951514:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888d07d6b800/5155986d-40a3-4b00-bd4e-464c33a61073 for MGS 00000020:00000080:1.0:1790972594.951553:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d07d6b000 for MGS 00000040:00080000:3.0:1790972595.380869:0:17114:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790972595.380878:0:17114:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790972595.380897:0:17114:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790972595.380918:0:17114:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790972595.445380:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790972595.445465:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397637504:0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.445473:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397637632:0@lo:400:kworker.0 00000100:00100000:0.0:1790972595.445577:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877970397637760:0@lo:400:kworker.0 00000100:00100000:3.0:1790972595.445829:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397637376:0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.446363:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972595.446480:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5da60518-8817-4c86-8417-ee73ae6d3f86:3640:1877970397637248:0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.446512:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972595.446541:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397638144:0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.446558:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972595.446572:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877970397638656:0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.446590:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972595.446621:0:18587:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397637632 00000100:00100000:2.0:1790972595.446629:0:18587:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397637632 00000100:00100000:2.0:1790972595.446694:0:18587:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397638144 00000100:00100000:2.0:1790972595.446698:0:18587:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397638144 00000100:00100000:2.0:1790972595.446717:0:18587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790972595.446740:0:18587:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e08b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397637632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972595.447084:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972595.447110:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877970397638272:0@lo:400:kworker.0 00000100:00100000:0.0:1790972595.447136:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972595.447153:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877970397638784:0@lo:400:kworker.0 00000100:00100000:0.0:1790972595.447177:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972595.447222:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397638656 00000100:00100000:0.0:1790972595.447226:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397638656 00000100:00100000:1.0:1790972595.447340:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972595.447367:0:18587:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e08b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397637632:12345-0@lo:400:kworker.0 Request processed in 627us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972595.447376:0:18587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790972595.447730:0:18587:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397637504 00000100:00100000:2.0:1790972595.447735:0:18587:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397637504 00000100:00100000:1.0:1790972595.447743:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397638016:0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.447761:0:18587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790972595.447777:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972595.447790:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877970397638528:0@lo:400:kworker.0 00000100:00100000:1.0:1790972595.447809:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790972595.447831:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790972595.447835:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790972595.447843:0:18587:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e08b83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397638144:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1790972595.447845:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790972595.447857:0:19023:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397638016 00000100:00100000:1.0:1790972595.447863:0:19023:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397638016 00000100:00100000:2.0:1790972595.447898:0:18587:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e08b83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397638144:12345-0@lo:400:kworker.0 Request processed in 128us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972595.447899:0:19023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790972595.447911:0:18587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790972595.447911:0:19023:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397637504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.447943:0:18587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790972595.447954:0:18587:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397638016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972595.447965:0:19023:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397637504:12345-0@lo:400:kworker.0 Request processed in 56us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972595.447972:0:19023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1790972595.447986:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790972595.448008:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397637504:0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.448072:0:18587:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397638016:12345-0@lo:400:kworker.0 Request processed in 121us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972595.448079:0:18587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790972595.448082:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397637760 00000100:00100000:0.0:1790972595.448087:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397637760 00000100:00100000:0.0:1790972595.448106:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397638272 00000100:00100000:0.0:1790972595.448108:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397638272 00000100:00100000:2.0:1790972595.448118:0:17074:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397637248 00000100:00100000:0.0:1790972595.448121:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397638784 00000100:00100000:2.0:1790972595.448124:0:17074:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397637248 00000100:00100000:0.0:1790972595.448126:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397638784 00000100:00100000:0.0:1790972595.448151:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397638528 00000100:00100000:0.0:1790972595.448153:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397638528 00000100:00100000:2.0:1790972595.448162:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1790972595.448174:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790972595.448175:0:17074:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5da60518-8817-4c86-8417-ee73ae6d3f86+24:3640:x1877970397637248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972595.448186:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e08b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877970397638656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972595.448222:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e08b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3640:x1877970397638656:12345-0@lo:400:kworker.0 Request processed in 40us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972595.448228:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1790972595.448239:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790972595.448245:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877970397637760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.448376:0:17074:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d545850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5da60518-8817-4c86-8417-ee73ae6d3f86+24:3640:x1877970397637248:12345-0@lo:400:kworker.0 Request processed in 206us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972595.448383:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1790972595.448488:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790972595.448496:0:17080:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877970397638272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.448536:0:17080:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877970397638272:12345-0@lo:400:kworker.0 Request processed in 42us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972595.448552:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790972595.448573:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790972595.448581:0:17080:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877970397638784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972595.448602:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972595.448621:0:17080:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877970397638784:12345-0@lo:400:kworker.0 Request processed in 41us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972595.448628:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790972595.448637:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397637888:0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.448643:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790972595.448679:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972595.448696:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877970397638400:0@lo:400:kworker.0 00000100:00100000:3.0:1790972595.448715:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972595.448784:0:17079:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1790972595.448792:0:17079:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1790972595.448804:0:18547:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1790972595.448809:0:18547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397638400 00000100:00100000:3.0:1790972595.448812:0:18547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397638400 00000100:00100000:3.0:1790972595.448830:0:18547:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1790972595.448836:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790972595.448850:0:18547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877970397638400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.448870:0:17080:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877970397638528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972595.448885:0:18547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877970397638400:12345-0@lo:400:kworker.0 Request processed in 35us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972595.448892:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790972595.448917:0:17086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397637376 00000100:00100000:2.0:1790972595.448918:0:17080:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877970397638528:12345-0@lo:400:kworker.0 Request processed in 266us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972595.448922:0:17086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397637376 00000100:00100000:2.0:1790972595.448938:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790972595.448956:0:17086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397637888 00000100:00100000:3.0:1790972595.448959:0:17086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397637888 00000100:00100000:3.0:1790972595.448971:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790972595.448979:0:17086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397637376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.449001:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397638144:0@lo:400:kworker.0 00000100:00100000:3.0:1790972595.449016:0:17086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397637376:12345-0@lo:400:kworker.0 Request processed in 36us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972595.449022:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877970397638656:0@lo:400:kworker.0 00000100:00100000:3.0:1790972595.449027:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790972595.449041:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397637632:0@lo:400:kworker.0 00000100:00100000:3.0:1790972595.449045:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790972595.449056:0:17086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397637888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972595.449060:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5da60518-8817-4c86-8417-ee73ae6d3f86:3640:1877970397637248:0@lo:400:kworker.0 00000100:00100000:3.0:1790972595.449090:0:17086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397637888:12345-0@lo:400:kworker.0 Request processed in 36us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972595.449098:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790972595.449121:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397638912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790972595.449148:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972595.449182:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397637376:0@lo:400:kworker.0 00000100:00100000:3.0:1790972595.449192:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397637888:0@lo:400:kworker.0 00000100:00100000:3.0:1790972595.449201:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877970397638400:0@lo:400:kworker.0 00000100:00100000:3.0:1790972595.449214:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790972595.449219:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397639040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790972595.449554:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397638912 00000100:00100000:2.0:1790972595.449560:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397638912 00000100:00100000:2.0:1790972595.449591:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790972595.449598:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f6c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397638912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790972595.449625:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790972595.449683:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f6c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397638912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972595.449690:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1790972595.450014:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790972595.450018:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790972595.450046:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397638016:0@lo:400:kworker.0 00010000:00080000:1.0:1790972595.450060:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888d08894e00 x1877970397638528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972595.450070:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08894e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877970397638528:0@lo:400:kworker.0 00000100:00100000:0.0:1790972595.450174:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877970397637760:12345-0@lo:400:kworker.0 Request processed in 1928us (3090us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972595.450181:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790972595.450211:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877970397637760:0@lo:400:kworker.0 00000100:00100000:0.0:1790972595.450223:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877970397638272:0@lo:400:kworker.0 00010000:00080000:0.0:1790972595.450233:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888d08897800 x1877970397638784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972595.450242:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877970397638784:0@lo:400:kworker.0 00000100:00100000:3.0:1790972595.452445:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972595.452543:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397638912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790972595.452945:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397639040 00000100:00100000:1.0:1790972595.452954:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397639040 00000100:00100000:1.0:1790972595.453007:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790972595.453018:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397639040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790972595.453041:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790972595.453117:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397639040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972595.453125:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790972595.454130:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397639040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790972595.831973:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790972595.957126:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790972595.957150:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397639168:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790972595.957241:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972595.957439:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397639168 00000100:00100000:3.0:1790972595.957448:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397639168 00000100:00100000:3.0:1790972595.957506:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790972595.957524:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397639168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790972595.957552:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790972595.957602:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05488000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397639168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972595.957608:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790972595.957657:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397639168:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1790972596.859061:0:17831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790972596.860567:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790972596.881269:0:20651:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1790972596.885788:0:20651:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1790972596.885869:0:20651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7e00/0xd61f4faa13a11097 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1109e expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972596.885884:0:20651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7e00/0xd61f4faa13a11097 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a1109e expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972596.885891:0:20651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7e00/0xd61f4faa13a11097 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a1109e expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972596.885899:0:20651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888d07bb7e00/0xd61f4faa13a11097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a1109e expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972596.885931:0:20651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790972596.885937:0:20651:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790972596.885979:0:20651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790972596.885984:0:20651:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1790972596.885989:0:20651:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790972596.886015:0:20651:0:(import.c:65:import_set_state_nolock()) ffff888d08932000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790972596.886048:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877970397639296:0@lo:39:umount.0 00000100:00100000:2.0:1790972596.886125:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790972596.886181:0:20105:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972596.886189:0:20105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888d07bb7e00/0xd61f4faa13a11097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a1109e expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.886197:0:20105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb7e00 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:3.0:1790972596.886200:0:20105:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb7e00/0xd61f4faa13a11097 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a1109e expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.886208:0:20105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888d07bb7e00/0xd61f4faa13a11097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a1109e expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790972596.886215:0:20105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb7e00/0xd61f4faa13a11097 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a1109e expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972596.886220:0:20105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790972596.886223:0:20105:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1790972596.886225:0:20105:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1790972596.886257:0:20105:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888d07bb7e00/0xd61f4faa13a11097 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a1109e expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.886264:0:20105:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1790972596.886310:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5da60518-8817-4c86-8417-ee73ae6d3f86:3641:1877970397639424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790972596.886341:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790972596.886390:0:20105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888d07bb7e00/0xd61f4faa13a11097 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a1109e expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.886398:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888d07bb7e00/0xd61f4faa13a11097 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a1109e expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.886408:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972596.886421:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972596.886422:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972596.886438:0:18547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397639296 00000100:00100000:3.0:1790972596.886444:0:18547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397639296 00000100:00100000:3.0:1790972596.886491:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790972596.886499:0:18547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e08b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877970397639296:12345-0@lo:39:umount.0 00000020:00000080:3.0:1790972596.886525:0:18547:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a110c8 00000100:00080000:3.0:1790972596.886533:0:18547:0:(import.c:65:import_set_state_nolock()) ffff888e352ef000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1790972596.886563:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972596.887181:0:18547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e08b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3637:x1877970397639296:12345-0@lo:39:umount.0 Request processed in 676us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972596.887189:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790972596.888178:0:17065:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397639424 00000100:00100000:0.0:1790972596.888187:0:17065:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397639424 00000100:00100000:0.0:1790972596.888236:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790972596.888245:0:17065:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e08b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5da60518-8817-4c86-8417-ee73ae6d3f86+24:3641:x1877970397639424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972596.888258:0:17065:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972596.888275:0:17065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3ad43a00/0xd61f4faa13a1109e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a11097 expref: 24 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972596.888298:0:17065:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:3.0:1790972596.888453:0:18547:0:(genops.c:885:class_export_put()) final put ffff888e352ee000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790972596.888493:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e352ee000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790972596.888537:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e352ef000 for lustre-MDT0000 00000100:00080000:3.0:1790972596.888573:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d08932000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790972596.888585:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877970397639296:0@lo:39:umount.0 00000100:00100000:0.0:1790972596.891539:0:17065:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e08b82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5da60518-8817-4c86-8417-ee73ae6d3f86+23:3641:x1877970397639424:12345-0@lo:103:ldlm_bl.0 Request processed in 3286us (5187us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972596.891555:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1790972596.891907:0:20651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790972596.891912:0:20651:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790972596.891941:0:20651:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1790972596.892861:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5da60518-8817-4c86-8417-ee73ae6d3f86:3641:1877970397639424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790972596.894044:0:20651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6e00/0xd61f4faa13a10fe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a10fef expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.894060:0:20651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6e00/0xd61f4faa13a10fe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a10fef expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.894138:0:20651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6e00/0xd61f4faa13a10fe8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a10fef expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.894146:0:20651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888d07bb6e00/0xd61f4faa13a10fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a10fef expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.894199:0:20651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972596.894207:0:20651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43400/0xd61f4faa13a113fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11402 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.894215:0:20651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43400/0xd61f4faa13a113fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11402 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.894221:0:20651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43400/0xd61f4faa13a113fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a11402 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.894226:0:20651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888e3ad43400/0xd61f4faa13a113fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a11402 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972596.894280:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790972596.894288:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888d07bb6e00/0xd61f4faa13a10fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a10fef expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972596.894295:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb6e00 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:0.0:1790972596.894299:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb6e00/0xd61f4faa13a10fe8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a10fef expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972596.894307:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888d07bb6e00/0xd61f4faa13a10fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a10fef expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790972596.894313:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb6e00/0xd61f4faa13a10fe8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a10fef expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972596.894319:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790972596.894321:0:17069:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1790972596.894366:0:17069:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888d07bb6e00/0xd61f4faa13a10fe8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a10fef expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972596.894373:0:17069:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790972596.894400:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888d07bb6e00/0xd61f4faa13a10fe8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a10fef expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972596.894405:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1790972596.894407:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888d07bb6e00/0xd61f4faa13a10fe8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a10fef expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972596.894425:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5da60518-8817-4c86-8417-ee73ae6d3f86:3639:1877970397639552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972596.894431:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790972596.894433:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3ad43400/0xd61f4faa13a113fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a11402 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972596.894438:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad43400 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:0.0:1790972596.894441:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad43400/0xd61f4faa13a113fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a11402 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972596.894447:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3ad43400/0xd61f4faa13a113fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a11402 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790972596.894452:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad43400/0xd61f4faa13a113fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a11402 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972596.894456:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1790972596.894458:0:17069:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:0.0:1790972596.894469:0:17069:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3ad43400/0xd61f4faa13a113fb lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a11402 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972596.894474:0:17069:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790972596.894482:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3ad43400/0xd61f4faa13a113fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a11402 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972596.894487:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790972596.894499:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972596.894501:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972596.894502:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972596.894508:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790972596.894517:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5da60518-8817-4c86-8417-ee73ae6d3f86:3638:1877970397639680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790972596.894536:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397639552 00000100:00100000:1.0:1790972596.894542:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397639552 00000100:00100000:0.0:1790972596.894542:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972596.894565:0:20106:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397639680 00000100:00100000:0.0:1790972596.894568:0:20106:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397639680 00000100:00100000:1.0:1790972596.894584:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790972596.894594:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5da60518-8817-4c86-8417-ee73ae6d3f86+24:3639:x1877970397639552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790972596.894607:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790972596.894610:0:20106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790972596.894618:0:20106:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5da60518-8817-4c86-8417-ee73ae6d3f86+24:3638:x1877970397639680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790972596.894622:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3ad43600/0xd61f4faa13a10fef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a10fe8 expref: 24 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972596.894625:0:20106:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972596.894632:0:20106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdc600/0xd61f4faa13a11402 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a113fb expref: 23 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972596.894642:0:20106:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790972596.894645:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790972596.894782:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5da60518-8817-4c86-8417-ee73ae6d3f86+22:3639:x1877970397639552:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972596.894791:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790972596.894832:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5da60518-8817-4c86-8417-ee73ae6d3f86:3639:1877970397639552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790972596.894850:0:20106:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa01f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5da60518-8817-4c86-8417-ee73ae6d3f86+21:3638:x1877970397639680:12345-0@lo:103:ldlm_bl.0 Request processed in 234us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972596.894857:0:20106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790972596.894886:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5da60518-8817-4c86-8417-ee73ae6d3f86:3638:1877970397639680:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790972596.895498:0:20651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790972596.895506:0:20651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3ad43400/0xd61f4faa13a113fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a11402 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972596.895529:0:20651:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790972596.895547:0:20651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d06bdd600/0xd61f4faa13a1159f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a115a6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.895554:0:20651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d06bdd600/0xd61f4faa13a1159f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a115a6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.895560:0:20651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d06bdd600/0xd61f4faa13a1159f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a115a6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.895566:0:20651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888d06bdd600/0xd61f4faa13a1159f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a115a6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.895634:0:20651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790972596.895637:0:20105:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972596.895641:0:20651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42a00/0xd61f4faa13a10fda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a10fe1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972596.895646:0:20105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888d06bdd600/0xd61f4faa13a1159f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a115a6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.895680:0:20651:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42a00/0xd61f4faa13a10fda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a10fe1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972596.895684:0:20105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdd600 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:2.0:1790972596.895690:0:20105:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888d06bdd600/0xd61f4faa13a1159f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a115a6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.895693:0:20651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42a00/0xd61f4faa13a10fda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a10fe1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972596.895707:0:20105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888d06bdd600/0xd61f4faa13a1159f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a115a6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972596.895719:0:20651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888e3ad42a00/0xd61f4faa13a10fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a10fe1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790972596.895719:0:20105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888d06bdd600/0xd61f4faa13a1159f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a115a6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972596.895731:0:20105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790972596.895736:0:20105:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1790972596.895740:0:20105:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790972596.895748:0:20651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790972596.895753:0:20651:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1790972596.895756:0:20651:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1790972596.895797:0:20651:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1790972596.895802:0:20651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:2.0:1790972596.895803:0:20105:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888d06bdd600/0xd61f4faa13a1159f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a115a6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1790972596.895807:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1790972596.895811:0:20105:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:3.0:1790972596.895821:0:20651:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:3.0:1790972596.895829:0:20651:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff888d07d6d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1790972596.895833:0:20105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888d06bdd600/0xd61f4faa13a1159f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a115a6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790972596.895837:0:20651:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff888d05df8000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1790972596.895848:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888d06bdd600/0xd61f4faa13a1159f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a115a6 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790972596.895850:0:20651:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff888e3ac8a800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790972596.895864:0:20651:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff888e394b4800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790972596.895872:0:20651:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff888e1f7ed800 7ce7d447-3508-49e7-832d-5367b174a2f4 192.168.203.39@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:3.0:1790972596.895876:0:20651:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff888d07d68000 756609d8-0e63-4567-bff3-21a421fa0eb0 192.168.203.39@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:3.0:1790972596.895881:0:20651:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff888e3d8199c0) has exports, disconnecting them 00000020:00080000:3.0:1790972596.895885:0:20651:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff888d07d6d800), last request at 1790972595 00000020:00000080:3.0:1790972596.895892:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a113d1 00000100:00080000:3.0:1790972596.895908:0:20651:0:(import.c:65:import_set_state_nolock()) ffff888d07d6d000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790972596.895973:0:20651:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888d07d6d800): rc 0 00000020:00000080:3.0:1790972596.895975:0:20651:0:(genops.c:885:class_export_put()) final put ffff888d07d6d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1790972596.895989:0:20651:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff888d05df8000), last request at 1790972595 00000020:00000080:3.0:1790972596.895992:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11265 00000100:00080000:3.0:1790972596.895998:0:20651:0:(import.c:65:import_set_state_nolock()) ffff888d05df9800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790972596.896004:0:20651:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888d05df8000): rc 0 00000020:00000080:3.0:1790972596.896006:0:20651:0:(genops.c:885:class_export_put()) final put ffff888d05df8000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1790972596.896009:0:20651:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff888e3ac8a800), last request at 1790972514 00000020:00000080:3.0:1790972596.896012:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a111b6 00000100:00080000:3.0:1790972596.896015:0:20651:0:(import.c:65:import_set_state_nolock()) ffff888e394b2800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1790972596.896019:0:20651:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888e3ac8a800): rc 0 00000020:00000080:3.0:1790972596.896021:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e3ac8a800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1790972596.896024:0:20651:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff888e394b4800), last request at 1790972514 00000020:00000080:3.0:1790972596.896027:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1115b 00000100:00080000:3.0:1790972596.896029:0:20651:0:(import.c:65:import_set_state_nolock()) ffff888e394b6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790972596.896042:0:20651:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00080000:3.0:1790972596.896117:0:20651:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888e394b4800): rc 0 00000004:00000080:3.0:1790972596.896123:0:20651:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9f73c1c57ae0 00000100:00080000:3.0:1790972596.896140:0:20651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790972596.896143:0:20651:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:2.0:1790972596.896161:0:20105:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972596.896167:0:20105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3ad42a00/0xd61f4faa13a10fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a10fe1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972596.896173:0:20105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad42a00 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:2.0:1790972596.896176:0:20105:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad42a00/0xd61f4faa13a10fda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a10fe1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972596.896191:0:20105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3ad42a00/0xd61f4faa13a10fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a10fe1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790972596.896198:0:20105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad42a00/0xd61f4faa13a10fda lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a10fe1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972596.896204:0:20105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1790972596.896206:0:20105:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790972596.896208:0:20105:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1790972596.896224:0:20105:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3ad42a00/0xd61f4faa13a10fda lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a10fe1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972596.896230:0:20105:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790972596.896237:0:20105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3ad42a00/0xd61f4faa13a10fda lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a10fe1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972596.896244:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3ad42a00/0xd61f4faa13a10fda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a10fe1 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972596.896264:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972596.896275:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972596.896278:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790972596.896962:0:20651:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790972596.896980:0:20651:0:(import.c:65:import_set_state_nolock()) ffff888d05daa800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1790972596.897011:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397640064:0@lo:39:umount.0 00000100:00100000:3.0:1790972596.897065:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972596.897099:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e08b83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5da60518-8817-4c86-8417-ee73ae6d3f86:3640:1877970397639808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790972596.897111:0:17086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397640064 00000100:00100000:3.0:1790972596.897119:0:17086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397640064 00000100:00100000:2.0:1790972596.897146:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972596.897158:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790972596.897167:0:17086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1877970397640064:12345-0@lo:39:umount.0 00000100:00100000:2.0:1790972596.897187:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00000080:3.0:1790972596.897194:0:17086:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a111e0 00000100:00100000:2.0:1790972596.897198:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5da60518-8817-4c86-8417-ee73ae6d3f86:3640:1877970397639936:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1790972596.897202:0:17086:0:(import.c:65:import_set_state_nolock()) ffff888e394b2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1790972596.897220:0:17086:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790972596.897226:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790972596.897249:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972596.897316:0:17086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+3:3637:x1877970397640064:12345-0@lo:39:umount.0 Request processed in 151us (251us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1790972596.897323:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1790972596.897608:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d05daa800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1790972596.897626:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397640064:0@lo:39:umount.0 00010000:00010000:0.0:1790972596.898039:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972596.898048:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790972596.898377:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888d07d6d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1790972596.898564:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888d05df8000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:2.0:1790972596.901971:0:20651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790972596.901981:0:20651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1790972596.901999:0:20651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790972596.902066:0:20651:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790972596.902095:0:20651:0:(import.c:65:import_set_state_nolock()) ffff888d05da9000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1790972596.902112:0:20651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790972596.902114:0:20651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1790972596.902123:0:20651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790972596.902192:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397640192:0@lo:9:umount.0 00000100:00100000:2.0:1790972596.902258:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790972596.902304:0:20651:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790972596.902315:0:20651:0:(import.c:65:import_set_state_nolock()) ffff888e04995800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790972596.902333:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397640320:0@lo:9:umount.0 00000100:00100000:2.0:1790972596.902358:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972596.902389:0:18587:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397640192 00000100:00100000:2.0:1790972596.902397:0:18587:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397640192 00000100:00100000:2.0:1790972596.902626:0:18587:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397640320 00000100:00100000:2.0:1790972596.902631:0:18587:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397640320 00000100:00100000:2.0:1790972596.902682:0:18587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790972596.902691:0:18587:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877970397640192:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790972596.902888:0:18587:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a112ab 00000100:00080000:2.0:1790972596.902896:0:18587:0:(import.c:65:import_set_state_nolock()) ffff888d05dea800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790972596.903055:0:18587:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1790972596.903207:0:18587:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3637:x1877970397640192:12345-0@lo:9:umount.0 Request processed in 517us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972596.903215:0:18587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790972596.903245:0:18587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790972596.903252:0:18587:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1877970397640320:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790972596.903264:0:18587:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11409 00000100:00080000:2.0:1790972596.903269:0:18587:0:(import.c:65:import_set_state_nolock()) ffff888e3d4b8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790972596.903291:0:18587:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1790972596.903362:0:18587:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d570000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3637:x1877970397640320:12345-0@lo:9:umount.0 Request processed in 111us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972596.903369:0:18587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1790972596.903401:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790972596.903574:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e04995800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790972596.903581:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790972596.903582:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790972596.903586:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397640320:0@lo:9:umount.0 00000100:00080000:2.0:1790972596.903681:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d05da9000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1790972596.903693:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1790972596.903694:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790972596.903697:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397640192:0@lo:9:umount.0 00000020:00080000:2.0:1790972596.904101:0:20651:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff888e3d8199c0) has no exports 00010000:00010000:0.0:1790972596.904290:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790972596.905516:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ac8a800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000100:00100000:0.0:1790972596.906183:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397639808 00000100:00100000:0.0:1790972596.906194:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397639808 00000100:00100000:0.0:1790972596.906244:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397639936 00000100:00100000:0.0:1790972596.906248:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397639936 00000100:00100000:0.0:1790972596.906272:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790972596.906280:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5da60518-8817-4c86-8417-ee73ae6d3f86+22:3640:x1877970397639808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972596.906310:0:17066:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972596.906327:0:17066:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e09feba00/0xd61f4faa13a115a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a1159f expref: 22 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972596.906343:0:17066:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790972596.906489:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790972596.906499:0:17067:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5da60518-8817-4c86-8417-ee73ae6d3f86+21:3640:x1877970397639936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790972596.906507:0:17067:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790972596.906517:0:17067:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e0dfd7e00/0xd61f4faa13a10fe1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a10fda expref: 21 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972596.906532:0:17067:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790972596.906558:0:17067:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d572a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5da60518-8817-4c86-8417-ee73ae6d3f86+20:3640:x1877970397639936:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (9333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972596.906564:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790972596.907087:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5da60518-8817-4c86-8417-ee73ae6d3f86+19:3640:x1877970397639808:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (9266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972596.907096:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790972596.907168:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5da60518-8817-4c86-8417-ee73ae6d3f86:3640:1877970397639936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790972596.907178:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e08b83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5da60518-8817-4c86-8417-ee73ae6d3f86:3640:1877970397639808:0@lo:103:ldlm_bl.0 00000020:00000080:1.0:1790972596.907255:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d07d6d000 for lustre-MDT0000 00000020:00000080:1.0:1790972596.907262:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d05df9800 for lustre-MDT0000 00000020:00000080:1.0:1790972596.907268:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e394b2800 for lustre-MDT0000 00000020:00080000:2.0:1790972596.919862:0:20651:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff888e3d8199c0) has no exports 00000100:00100000:3.0:1790972596.980823:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790972596.981265:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397640448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790972596.981339:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972596.981394:0:17085:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397640448 00000100:00100000:3.0:1790972596.981401:0:17085:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397640448 00000100:00100000:3.0:1790972596.981452:0:17085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790972596.981459:0:17085:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1877970397640448:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1790972596.981466:0:17085:0:(tgt_handler.c:821:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1790972596.981518:0:17085:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3639:x1877970397640448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (179us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790972596.981527:0:17085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:02020000:3.0:1790972596.981568:0:3639:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000020:00000080:2.0:1790972596.981657:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11035 00000100:00080000:3.0:1790972596.988686:0:3639:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1790972596.988697:0:3639:0:(import.c:65:import_set_state_nolock()) ffff888e06810000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1790972596.988703:0:3639:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000020:00000080:2.0:1790972596.992151:0:20651:0:(genops.c:885:class_export_put()) final put ffff888d05dac800/lustre-QMT0000_UUID 00000020:01000000:2.0:1790972596.992176:0:20651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1790972596.994022:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888d05dac800/lustre-QMT0000_UUID for lustre-QMT0000 00000100:00080000:3.0:1790972597.005462:0:3639:0:(import.c:65:import_set_state_nolock()) ffff888e06810000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790972597.005478:0:3639:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 452 00000100:00080000:3.0:1790972597.005495:0:3639:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff888e06810000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1790972597.005634:0:3639:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3a7d2d80 x1877970397640576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790972597.005729:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397640576:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1790972597.005800:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1790972597.006358:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790972597.006369:0:20651:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790972597.006373:0:20651:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff888e3d420000) has no exports 00000100:00100000:3.0:1790972597.006552:0:18145:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397640576 00000100:00100000:3.0:1790972597.006561:0:18145:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397640576 00000100:00100000:3.0:1790972597.006597:0:18145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790972597.006605:0:18145:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1877970397640576:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1790972597.006621:0:18145:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000020:00000080:0.0:1790972597.006685:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1102e 00000020:00000080:0.0:1790972597.006693:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e09a7a800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1790972597.006761:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790972597.006769:0:20651:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790972597.006772:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e09a78800/lustre-QMT0000_UUID 00000020:00000080:0.0:1790972597.006775:0:20651:0:(genops.c:844:class_export_destroy()) destroying export ffff888e09a78800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1790972597.006785:0:20651:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1790972597.006835:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888e09a7a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1790972597.012459:0:18145:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1877970397640576:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 5846us (6651us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790972597.012474:0:18145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1790972597.012558:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e06810000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790972597.012564:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790972597.012569:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397640576:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1790972597.880085:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972598.900965:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790972599.032874:0:17811:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1790972599.032900:0:17811:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1790972599.032914:0:17811:0:(genops.c:885:class_export_put()) final put ffff888e3aad7800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1790972599.032936:0:17811:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7ce7d447-3508-49e7-832d-5367b174a2f4 00000001:00080000:3.0:1790972599.032942:0:17811:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1790972599.032944:0:17811:0:(genops.c:885:class_export_put()) final put ffff888e1f7ec800/7ce7d447-3508-49e7-832d-5367b174a2f4 00000001:00100000:3.0:1790972599.032964:0:17811:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 756609d8-0e63-4567-bff3-21a421fa0eb0 00000001:00080000:3.0:1790972599.032969:0:17811:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1790972599.032970:0:17811:0:(genops.c:885:class_export_put()) final put ffff888e3a750800/756609d8-0e63-4567-bff3-21a421fa0eb0 00000020:00000080:1.0:1790972599.033087:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3aad7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1790972599.033147:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888e1f7ec800/7ce7d447-3508-49e7-832d-5367b174a2f4 for lustre-MDT0001 00000020:00000080:1.0:1790972599.033174:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3a750800/756609d8-0e63-4567-bff3-21a421fa0eb0 for lustre-MDT0001 00000020:00000080:1.0:1790972599.033196:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e394b2000 for lustre-MDT0001 00000020:00000080:1.0:1790972599.033201:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d05dfe800 for lustre-MDT0001 00000020:00000080:1.0:1790972599.033204:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e3a755800 for lustre-MDT0001 00000001:00100000:0.0:1790972599.033366:0:17060:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790972599.033376:0:17060:0:(genops.c:885:class_export_put()) final put ffff888e394b4800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1790972599.033393:0:17060:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7ce7d447-3508-49e7-832d-5367b174a2f4 00000001:00080000:0.0:1790972599.033399:0:17060:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:0.0:1790972599.033401:0:17060:0:(genops.c:885:class_export_put()) final put ffff888e1f7ed800/7ce7d447-3508-49e7-832d-5367b174a2f4 00000001:00100000:0.0:1790972599.033406:0:17060:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 756609d8-0e63-4567-bff3-21a421fa0eb0 00000001:00080000:0.0:1790972599.033410:0:17060:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:0.0:1790972599.033416:0:17060:0:(genops.c:885:class_export_put()) final put ffff888d07d68000/756609d8-0e63-4567-bff3-21a421fa0eb0 00000020:00000080:3.0:1790972599.033461:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e394b4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1790972599.033496:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e1f7ed800/7ce7d447-3508-49e7-832d-5367b174a2f4 for lustre-MDT0000 00000020:00000080:3.0:1790972599.033528:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888d07d68000/756609d8-0e63-4567-bff3-21a421fa0eb0 for lustre-MDT0000 00000020:00000080:3.0:1790972599.033552:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e394b6800 for lustre-MDT0000 00000020:00000080:3.0:1790972599.033556:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e1f7ee800 for lustre-MDT0000 00000020:00000080:3.0:1790972599.033560:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d07d6a800 for lustre-MDT0000 00010000:00010000:0.0:1790972599.924804:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972600.565782:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790972600.565806:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397640704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790972600.565874:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972600.565994:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397640704 00000100:00100000:2.0:1790972600.566003:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397640704 00000100:00100000:2.0:1790972600.566063:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790972600.566073:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397640704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790972600.566105:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790972600.566154:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397640704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972600.566174:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790972600.566220:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397640704:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1790972600.566291:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790972600.570053:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790972600.570060:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790972600.570064:0:471:0:(import.c:65:import_set_state_nolock()) ffff888e06810000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790972600.570072:0:471:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 535 00000100:00080000:2.0:1790972600.570078:0:471:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790972600.570089:0:471:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff888e06810000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1790972600.570117:0:471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3d570700 x1877970397640960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790972600.570178:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877970397641216:0@lo:400:kworker.0 00000100:00100000:2.0:1790972600.570245:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972600.570271:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397640960:0@lo:38:kworker.0 00000100:00100000:0.0:1790972600.570303:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972600.570307:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790972600.570312:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877970397641344:0@lo:400:kworker.0 00000100:00100000:2.0:1790972600.570332:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972600.570333:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397641216 00000100:00100000:0.0:1790972600.570339:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397641216 00000100:00100000:2.0:1790972600.570373:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877970397641728:0@lo:400:kworker.0 00000100:00100000:0.0:1790972600.570374:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397641344 00000100:00100000:0.0:1790972600.570376:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397641344 00000100:00100000:0.0:1790972600.570391:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790972600.570393:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972600.570398:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1877970397641216:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790972600.570405:0:17081:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790972600.570414:0:20572:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397641728 00000100:00100000:2.0:1790972600.570416:0:20572:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397641728 00000100:00100000:0.0:1790972600.570440:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1877970397641216:12345-0@lo:400:kworker.0 Request processed in 42us (195us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790972600.570445:0:20572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790972600.570449:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790972600.570451:0:20572:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877970397641728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972600.570464:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1790972600.570467:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1877970397641344:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1790972600.570470:0:17081:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1790972600.570488:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3638:x1877970397641344:12345-0@lo:400:kworker.0 Request processed in 20us (155us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790972600.570489:0:20572:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877970397641728:12345-0@lo:400:kworker.0 Request processed in 38us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972600.570494:0:20572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790972600.570506:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1790972600.570519:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1790972600.570557:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3d523b80 x1877970397641728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972600.570568:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d523b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877970397641728:0@lo:400:kworker.0 00000100:00080000:0.0:1790972600.570580:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790972600.570584:0:3638:0:(import.c:65:import_set_state_nolock()) ffff888d05dfe000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790972600.570587:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1790972600.570588:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5da60518-8817-4c86-8417-ee73ae6d3f86:3640:1877970397640832:0@lo:400:kworker.0 00000100:00100000:1.0:1790972600.570620:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972600.570653:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877970397641472:0@lo:400:kworker.0 00000100:00100000:1.0:1790972600.570689:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972600.570708:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790972600.570712:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397641088:0@lo:400:kworker.0 00000100:00100000:1.0:1790972600.570733:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972600.570746:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877970397641600:0@lo:400:kworker.0 00000100:00100000:1.0:1790972600.570765:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972600.570786:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397641472 00000100:00100000:1.0:1790972600.570795:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397641472 00000100:00100000:1.0:1790972600.570820:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397641600 00000100:00100000:1.0:1790972600.570823:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397641600 00000100:00100000:1.0:1790972600.570833:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790972600.570838:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877970397641472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972600.570873:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05489f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877970397641472:12345-0@lo:400:kworker.0 Request processed in 35us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972600.570880:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790972600.570905:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790972600.570909:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877970397641600:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790972600.570914:0:17081:0:(tgt_handler.c:821:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790972600.570936:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3640:x1877970397641600:12345-0@lo:400:kworker.0 Request processed in 25us (170us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790972600.570942:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1790972600.570956:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790972600.570973:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790972600.570976:0:3640:0:(import.c:65:import_set_state_nolock()) ffff888d07d68800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790972600.570979:0:3640:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790972600.570983:0:3640:0:(import.c:65:import_set_state_nolock()) ffff888d07d68800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790972600.570986:0:3640:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 492 00000100:00080000:1.0:1790972600.570992:0:3640:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff888d07d68800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1790972600.571008:0:3640:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e05488380 x1877970397641856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790972600.571024:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3640:1877970397641600:0@lo:400:kworker.0 00010000:00080000:1.0:1790972600.571037:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3d520e00 x1877970397641472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972600.571058:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877970397641472:0@lo:400:kworker.0 00000100:00100000:1.0:1790972600.571184:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877970397641856:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1790972600.571208:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972600.571233:0:17081:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397641856 00000100:00100000:1.0:1790972600.571237:0:17081:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397641856 00000100:00100000:1.0:1790972600.571254:0:17081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790972600.571259:0:17081:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1877970397641856:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1790972600.571272:0:17081:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790972600.571326:0:17075:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397640832 00000100:00100000:2.0:1790972600.571331:0:17075:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397640832 00000100:00100000:2.0:1790972600.571357:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790972600.571363:0:17075:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5da60518-8817-4c86-8417-ee73ae6d3f86+19:3640:x1877970397640832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972600.571400:0:17075:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d546050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5da60518-8817-4c86-8417-ee73ae6d3f86+19:3640:x1877970397640832:12345-0@lo:400:kworker.0 Request processed in 37us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972600.571407:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790972600.571805:0:17086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397640960 00000100:00100000:3.0:1790972600.571811:0:17086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397640960 00000100:00100000:3.0:1790972600.571835:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790972600.571840:0:17086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877970397640960:12345-0@lo:38:kworker.0 00010000:02000000:3.0:1790972600.571848:0:17086:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1790972600.571887:0:17086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877970397640960:12345-0@lo:38:kworker.0 Request processed in 46us (1583us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790972600.571902:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1790972600.571929:0:19787:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397641088 00000100:00100000:3.0:1790972600.571933:0:19787:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397641088 00000100:00100000:3.0:1790972600.571964:0:19787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790972600.571971:0:19787:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397641088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972600.572003:0:19787:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05489500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397641088:12345-0@lo:400:kworker.0 Request processed in 34us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972600.572009:0:19787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1790972600.572024:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790972600.572045:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e06810000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790972600.572050:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790972600.572053:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d570700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397640960:0@lo:38:kworker.0 00000100:00100000:3.0:1790972600.572113:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397641088:0@lo:400:kworker.0 00000100:00100000:3.0:1790972600.572122:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d571500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5da60518-8817-4c86-8417-ee73ae6d3f86:3640:1877970397640832:0@lo:400:kworker.0 00000100:00080000:0.0:1790972600.583443:0:3638:0:(import.c:65:import_set_state_nolock()) ffff888d05dfe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972600.583454:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 466 00000100:00080000:0.0:1790972600.583470:0:3638:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff888d05dfe000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972600.583511:0:3638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa00a80 x1877970397641984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790972600.583546:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877970397641344:0@lo:400:kworker.0 00000100:00080000:0.0:1790972600.583579:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1790972600.583582:0:3638:0:(import.c:65:import_set_state_nolock()) ffff888e3ac88800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1790972600.583585:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1790972600.583588:0:3638:0:(import.c:65:import_set_state_nolock()) ffff888e3ac88800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972600.583591:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 452 00000100:00080000:0.0:1790972600.583596:0:3638:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff888e3ac88800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972600.583609:0:3638:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa00700 x1877970397642112/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790972600.583639:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877970397641216:0@lo:400:kworker.0 00000100:00100000:3.0:1790972600.586628:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877970397641984:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1790972600.586737:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972600.586786:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877970397642112:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1790972600.586810:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972600.586922:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397641984 00000100:00100000:2.0:1790972600.586930:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397641984 00000100:00100000:2.0:1790972600.586968:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397642112 00000100:00100000:2.0:1790972600.586971:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397642112 00000100:00100000:2.0:1790972600.586993:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790972600.587000:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877970397641984:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1790972600.587017:0:17079:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790972600.587063:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877970397641984:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 62us (325us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790972600.587070:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790972600.587087:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790972600.587091:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877970397642112:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:2.0:1790972600.587098:0:17079:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1790972600.587124:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877970397642112:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 31us (313us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790972600.587129:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1790972600.587375:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d05dfe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790972600.587381:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790972600.587385:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877970397641984:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:3.0:1790972600.587394:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e3ac88800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790972600.587397:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790972600.587399:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877970397642112:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1790972600.602634:0:17081:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1877970397641856:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 31367us (31418us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790972600.602649:0:17081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1790972600.606133:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d07d68800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790972600.606145:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1790972600.606151:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05488380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877970397641856:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1790972600.949009:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972601.077190:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790972601.077227:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397642240:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790972601.077305:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972601.077537:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397642240 00000100:00100000:3.0:1790972601.077547:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397642240 00000100:00100000:3.0:1790972601.077595:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790972601.077605:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397642240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790972601.077636:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790972601.077719:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d523800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397642240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972601.077727:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790972601.078301:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397642240:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1790972601.973056:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972602.996797:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790972603.060787:0:20651:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff888e1d7695a0 - data ffff888e09336af8/ffff888e3a7ee000 00000020:01000000:0.0:1790972603.060941:0:20651:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff888d07b7e120 - data ffff888e1e01b6c0/ffff888e0429c000 00000001:00000004:0.0:1790972603.074047:0:20651:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000001:00100000:0.0:1790972603.128869:0:19400:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790972603.128887:0:19400:0:(genops.c:885:class_export_put()) final put ffff888e3d4bd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790972603.128914:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3d4bd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000001:00100000:0.0:1790972603.129213:0:18581:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790972603.129217:0:18581:0:(genops.c:885:class_export_put()) final put ffff888d05deb800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790972603.129241:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e3d4b8000 for lustre-OST0001 00000020:00000080:0.0:1790972603.129245:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888d05deb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1790972603.129264:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d05dea800 for lustre-OST0000 00000100:00080000:2.0:1790972603.131627:0:20651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790972603.131634:0:20651:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790972603.131647:0:20651:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff888e3a7d2680 x1877970397640064/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790972606 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972603.131703:0:20651:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1790972603.137226:0:20651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790972603.137234:0:20651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1790972603.137254:0:20651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790972603.137256:0:20651:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1790972603.137703:0:17104:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1790972603.137708:0:17104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1790972603.137718:0:17104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1790972603.140349:0:20651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790972603.140356:0:20651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1790972603.140381:0:20651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790972603.140384:0:20651:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790972603.142327:0:17106:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790972603.142334:0:17106:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:0.0:1790972603.142345:0:17106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1790972603.143535:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a10ffd 00000020:00000080:2.0:1790972603.143546:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e3f6d0800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790972603.144143:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3f6d0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790972603.146038:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11012 00000020:00000080:2.0:1790972603.146050:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e3f6d0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790972603.146067:0:20651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1790972603.146073:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790972603.146081:0:20651:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790972603.146084:0:20651:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff888e3d818000) has no exports 00000004:01000000:2.0:1790972603.146253:0:20651:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1790972603.146262:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11074 00000020:00000080:2.0:1790972603.146268:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e352e0000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1790972603.146273:0:20651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790972603.146277:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790972603.146282:0:20651:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790972603.146285:0:20651:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff888e169acd40) has no exports 00000020:00000080:2.0:1790972603.146291:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1106d 00000020:00000080:2.0:1790972603.146296:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e04997800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790972603.146592:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3f6d0000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1790972603.146602:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e352e0000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790972603.146606:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e04997800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1790972603.148026:0:20651:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790972603.148033:0:20651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790972603.148038:0:20651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1790972603.148045:0:20651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790972603.148048:0:20651:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790972603.148129:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790972603.148139:0:20651:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790972603.148146:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1105f 00000020:00000080:2.0:1790972603.148154:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e04990800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790972603.151641:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e04995800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1790972603.151674:0:38:0:(genops.c:885:class_export_put()) final put ffff888e04992800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790972603.151679:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e04992800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1790972603.151688:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790972603.153175:0:20651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1790972603.153202:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790972603.153212:0:20651:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790972603.153217:0:20651:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff888e3d043380) has no exports 00000020:00000080:2.0:1790972603.153226:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11058 00000020:00000080:2.0:1790972603.153234:0:20651:0:(genops.c:885:class_export_put()) final put ffff888d05dae000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790972603.154529:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e04990800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1790972603.155044:0:20651:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1790972603.155049:0:20651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790972603.155053:0:20651:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1790972603.155060:0:20651:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790972603.155062:0:20651:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790972603.155113:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888d05dae000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790972603.155197:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790972603.155205:0:20651:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1790972603.155222:0:20651:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1790972603.155230:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1104a 00000020:00000080:2.0:1790972603.155240:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e2cde7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790972603.155322:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d05da9000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1790972603.155339:0:38:0:(genops.c:885:class_export_put()) final put ffff888e2cde3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790972603.155341:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e2cde3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1790972603.155351:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790972603.155488:0:20651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1790972603.155493:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790972603.155499:0:20651:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790972603.155503:0:20651:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff888e3d044d40) has no exports 00000020:00000080:2.0:1790972603.155508:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11043 00000020:00000080:2.0:1790972603.155513:0:20651:0:(genops.c:885:class_export_put()) final put ffff888d05dad000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790972603.155535:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e2cde7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790972603.155971:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888d05dad000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1790972603.167151:0:20651:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1790972603.167173:0:20651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1790972603.167177:0:20651:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790972603.167187:0:20651:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790972603.167299:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790972603.167314:0:20651:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790972603.167342:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790972603.167346:0:20651:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790972603.167363:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e3f6d2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790972603.167367:0:20651:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3f6d2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1790972603.167384:0:20651:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790972603.167484:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11019 00000020:00000080:2.0:1790972603.167491:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e3f6d4000/lustre-MDD0000_UUID 00000020:00000080:1.0:1790972603.167540:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d05daa800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1790972603.167547:0:38:0:(genops.c:885:class_export_put()) final put ffff888d05dab000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790972603.167549:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888d05dab000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1790972603.167556:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790972603.167815:0:20651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1790972603.167820:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790972603.167826:0:20651:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790972603.167830:0:20651:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff888e3d81cd40) has no exports 00000020:00000080:2.0:1790972603.167850:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790972603.167854:0:20651:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1790972603.167858:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11020 00000020:00000080:2.0:1790972603.167862:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e3f6d5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790972603.167883:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3f6d4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1790972603.167887:0:38:0:(genops.c:885:class_export_put()) final put ffff888e3f6d1000/lustre-MDD0000_UUID 00000020:00000080:1.0:1790972603.167890:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3f6d1000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1790972603.167894:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:2.0:1790972603.167983:0:20651:0:(tgt_mount.c:187:server_put_mount()) put mount ffff888e3af96000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1790972603.167987:0:20651:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888e3af96000 3 00000020:01000004:2.0:1790972603.167990:0:20651:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff888e3af96000 from lustre-MDT0000 00000020:00000080:2.0:1790972603.168012:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790972603.168016:0:20651:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1790972603.168018:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e3f6d3800/lustre-MDT0000_UUID 00000020:00000080:2.0:1790972603.168020:0:20651:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3f6d3800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1790972603.168026:0:20651:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1790972603.168058:0:20651:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1790972603.168062:0:20651:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1790972603.168065:0:20651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1790972603.168082:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790972603.168114:0:20651:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790972603.168121:0:20651:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff888e029b3800 5da60518-8817-4c86-8417-ee73ae6d3f86 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790972603.168129:0:20651:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff888e3d0419c0) has exports, disconnecting them 00000020:00080000:2.0:1790972603.168134:0:20651:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff888e029b3800), last request at 1790972502 00000020:00000080:2.0:1790972603.168148:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a10fc5 00000020:00010000:2.0:1790972603.168152:0:20651:0:(genops.c:1920:obd_stale_export_put()) Put export ffff888e029b3800: total 1 00000100:00080000:2.0:1790972603.168155:0:20651:0:(import.c:65:import_set_state_nolock()) ffff888e029b4800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790972603.168169:0:20651:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888e029b3800): rc 0 00000020:00080000:2.0:1790972603.168173:0:20651:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff888e3d0419c0) has no exports 00000020:00010000:0.0:1790972603.168250:0:17069:0:(genops.c:1906:obd_stale_export_get()) Get export ffff888e029b3800: total 1 00010000:00010000:0.0:1790972603.168255:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972603.168290:0:17069:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff888e029b3800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1790972603.168320:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e0dfd6c00/0xd61f4faa13a10fd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a10fcc expref: 14 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168338:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdd400/0xd61f4faa13a110e4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a110dd expref: 13 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168361:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdce00/0xd61f4faa13a11250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a11249 expref: 12 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168382:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdc200/0xd61f4faa13a1157c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a11575 expref: 11 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168392:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d07bb6000/0xd61f4faa13a111a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a1119a expref: 10 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168401:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdc800/0xd61f4faa13a110f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a110eb expref: 9 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168412:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdd800/0xd61f4faa13a1158a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a11583 expref: 8 pid: 17072 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168421:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdcc00/0xd61f4faa13a11100 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a110f9 expref: 7 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168431:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdc400/0xd61f4faa13a11598 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a11591 expref: 6 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168447:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bddc00/0xd61f4faa13a1138b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a11384 expref: 5 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168457:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdd000/0xd61f4faa13a113b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a113ae expref: 4 pid: 17074 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168467:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3ad42400/0xd61f4faa13a11226 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a1121f expref: 3 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168488:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdd200/0xd61f4faa13a113f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd61f4faa13a113ed expref: 2 pid: 17075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972603.168510:0:17069:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff888e029b3800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1790972603.168525:0:17069:0:(genops.c:885:class_export_put()) final put ffff888e029b3800/5da60518-8817-4c86-8417-ee73ae6d3f86 00000100:00100000:2.0:1790972603.168558:0:17075:0:(service.c:3206:ptlrpc_main()) ll_mgs_0002: service thread [ffff888e08775c00:17075] 2 exiting: rc = 0 00000100:00100000:2.0:1790972603.168646:0:17074:0:(service.c:3206:ptlrpc_main()) ll_mgs_0001: service thread [ffff888e08775e00:17074] 1 exiting: rc = 0 00000020:00000080:1.0:1790972603.168844:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3f6d5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1790972603.168898:0:17072:0:(service.c:3206:ptlrpc_main()) ll_mgs_0000: service thread [ffff888e051f2e00:17072] 0 exiting: rc = 1 00000100:00100000:2.0:1790972603.168996:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169003:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169009:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169015:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169019:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169024:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169029:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169035:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169041:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169046:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169052:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169059:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169065:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169072:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169080:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169088:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169095:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169103:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169109:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169117:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169125:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169133:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169150:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169155:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169160:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169165:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169169:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169174:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169180:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169185:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169195:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169200:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169205:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169212:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169222:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169231:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169237:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169242:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169250:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169280:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169286:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169291:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169296:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169300:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169305:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169339:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169346:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169351:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169356:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169362:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169367:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169372:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169378:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169383:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169388:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169393:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169398:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169412:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169418:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169423:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169429:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169434:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169439:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972603.169445:0:20651:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1790972603.170049:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972603.170053:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972603.170056:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790972603.170123:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e029b3800/5da60518-8817-4c86-8417-ee73ae6d3f86 for MGS 00000020:00000080:1.0:1790972603.170210:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e029b4800 for MGS 00000020:01000000:2.0:1790972603.174634:0:20651:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff888e1d769600 - data ffff888e1e053e58/ffff888e3a7ecc00 00000020:01000000:2.0:1790972603.175146:0:20651:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff888d0886dd80 - data ffff888e092bcca8/ffff888e3f6a7400 00000020:00000080:2.0:1790972603.175719:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a10fa9 00000020:00000080:2.0:1790972603.175728:0:20651:0:(genops.c:885:class_export_put()) final put ffff888d08925000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1790972603.175742:0:20651:0:(tgt_mount.c:187:server_put_mount()) put mount ffff888e3af96000 from MGS, refs=2 00000020:01000004:2.0:1790972603.175746:0:20651:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888e3af96000 2 00000020:01000004:2.0:1790972603.175749:0:20651:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff888e3af96000 from MGS 00000020:00000080:2.0:1790972603.175769:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790972603.175775:0:20651:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1790972603.175778:0:20651:0:(genops.c:885:class_export_put()) final put ffff888d08927000/MGS 00000020:00000080:2.0:1790972603.175780:0:20651:0:(genops.c:844:class_export_destroy()) destroying export ffff888d08927000/MGS for MGS 00000020:00000080:1.0:1790972603.175846:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888d08925000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1790972603.175857:0:20651:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1790972603.176010:0:20651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1790972603.176015:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790972603.176021:0:20651:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790972603.176029:0:20651:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff888d08932800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790972603.176036:0:20651:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff888d078f0000) has exports, disconnecting them 00000020:00080000:2.0:1790972603.176043:0:20651:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff888d08932800), last request at 1790972502 00000020:00000080:2.0:1790972603.176136:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a110ac 00000020:00080000:2.0:1790972603.176149:0:20651:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888d08932800): rc 0 00000020:00000080:2.0:1790972603.176153:0:20651:0:(genops.c:885:class_export_put()) final put ffff888d08932800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790972603.176402:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888d08932800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1790972603.179743:0:20651:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1790972603.179752:0:20651:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790972603.179756:0:20651:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790972603.179763:0:20651:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790972603.180073:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790972603.180083:0:20651:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1790972603.180089:0:20651:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888e3af96000 1 00000020:00000080:0.0:1790972603.180096:0:20651:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a10f9b 00000020:00000080:0.0:1790972603.180105:0:20651:0:(genops.c:885:class_export_put()) final put ffff888d08921800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790972603.183010:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d08932000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1790972603.183025:0:38:0:(genops.c:885:class_export_put()) final put ffff888d08936800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1790972603.183028:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888d08936800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1790972603.183036:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1790972603.183094:0:20651:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1790972603.183118:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790972603.183125:0:20651:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790972603.183130:0:20651:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff888e3d4219c0) has no exports 00000020:00000080:1.0:1790972603.184411:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888d08921800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790972603.214212:0:20651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790972603.214225:0:20651:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790972603.214231:0:20651:0:(genops.c:885:class_export_put()) final put ffff888e3af93800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790972603.214246:0:20651:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3af93800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790972603.214260:0:20651:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790972603.214757:0:20651:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff888e3af94000 00000020:02000400:1.0:1790972603.214817:0:20651:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1790972604.030553:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972605.044766:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972605.684897:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397642368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1790972605.684961:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972605.685027:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397642368 00000100:00100000:3.0:1790972605.685034:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397642368 00000100:00100000:3.0:1790972605.685085:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790972605.685094:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397642368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790972605.685127:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790972605.685170:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397642368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972605.685177:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1790972605.685198:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790972605.685232:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397642368:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1790972605.685292:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790972605.685297:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790972605.685300:0:471:0:(import.c:65:import_set_state_nolock()) ffff888e06810000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972605.685306:0:471:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 538 00000100:00080000:0.0:1790972605.685311:0:471:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790972605.685317:0:471:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff888e06810000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972605.685339:0:471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa00380 x1877970397642624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790972605.685538:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790972605.685542:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790972605.685545:0:471:0:(import.c:65:import_set_state_nolock()) ffff888e3ac88800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972605.685549:0:471:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 538 00000100:00100000:1.0:1790972605.685551:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:0.0:1790972605.685554:0:471:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790972605.685561:0:471:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff888e3ac88800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1790972605.685566:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397642752:0@lo:400:kworker.0 00000100:00100000:0.0:1790972605.685578:0:471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa03480 x1877970397642880/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790972605.685589:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790972605.685592:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790972605.685595:0:471:0:(import.c:65:import_set_state_nolock()) ffff888d05dfe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972605.685599:0:471:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 538 00000100:00080000:0.0:1790972605.685602:0:471:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790972605.685608:0:471:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff888d05dfe000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1790972605.685609:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972605.685623:0:471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa03b80 x1877970397643008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790972605.685658:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5da60518-8817-4c86-8417-ee73ae6d3f86:3641:1877970397642496:0@lo:400:kworker.0 00000100:00080000:0.0:1790972605.685733:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790972605.685736:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1790972605.685738:0:471:0:(import.c:65:import_set_state_nolock()) ffff888d07d68800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972605.685741:0:471:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 538 00000100:00080000:0.0:1790972605.685744:0:471:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1790972605.685748:0:471:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff888d07d68800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972605.685758:0:471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa02a00 x1877970397643264/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790972605.685790:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397642624:0@lo:38:kworker.0 00000100:00100000:0.0:1790972605.685822:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972605.685843:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877970397642880:0@lo:38:kworker.0 00000100:00100000:0.0:1790972605.685882:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972605.685899:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877970397643008:0@lo:38:kworker.0 00000100:00100000:0.0:1790972605.685918:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:3.0:1790972605.685952:0:3641:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877970397642496 offset 0 length 224: 4 00000100:00100000:3.0:1790972605.685973:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790972605.685979:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877970397643392:0@lo:400:kworker.0 00000100:00100000:2.0:1790972605.690507:0:18585:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397642752 00000100:00100000:2.0:1790972605.690521:0:18585:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397642752 00000100:00100000:2.0:1790972605.690598:0:18585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790972605.690609:0:18585:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397642752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972605.691995:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877970397643136:0@lo:400:kworker.0 00000100:00100000:1.0:1790972605.692053:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972605.692888:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397642880 00000100:00100000:1.0:1790972605.692898:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397642880 00000100:00100000:1.0:1790972605.692933:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397643008 00000100:00100000:1.0:1790972605.692937:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397643008 00000100:00100000:1.0:1790972605.692952:0:17079:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397643136 00000100:00100000:1.0:1790972605.692954:0:17079:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397643136 00000100:00100000:1.0:1790972605.692980:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790972605.692989:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877970397643136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972605.693051:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877970397643136:12345-0@lo:400:kworker.0 Request processed in 65us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972605.693058:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790972605.693076:0:17079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790972605.693081:0:17079:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877970397642880:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1790972605.693099:0:17079:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790972605.693651:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972605.693708:0:17080:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397643392 00000100:00100000:3.0:1790972605.693713:0:17080:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397643392 00000100:00100000:3.0:1790972605.693743:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790972605.693750:0:17080:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877970397643392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972605.693796:0:17080:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877970397643392:12345-0@lo:400:kworker.0 Request processed in 46us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972605.693802:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790972605.693816:0:17080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790972605.693820:0:17080:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1877970397643008:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1790972605.693847:0:17080:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790972605.693888:0:17080:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1877970397643008:12345-0@lo:38:kworker.0 Request processed in 66us (7968us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790972605.693895:0:17080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1790972605.693951:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff888e3fa03100 x1877970397643392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972605.693965:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877970397643392:0@lo:400:kworker.0 00000100:00080000:0.0:1790972605.694127:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d05dfe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790972605.694133:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790972605.694137:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877970397643008:0@lo:38:kworker.0 00000100:00100000:0.0:1790972605.694146:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877970397643264:0@lo:38:kworker.0 00000100:00100000:0.0:1790972605.694177:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972605.694222:0:18547:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397643264 00000100:00100000:0.0:1790972605.694227:0:18547:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397643264 00000100:00100000:0.0:1790972605.694244:0:18547:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790972605.694248:0:18547:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1877970397643264:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1790972605.694259:0:18547:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790972605.694292:0:18547:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1877970397643264:12345-0@lo:38:kworker.0 Request processed in 41us (113us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790972605.694298:0:18547:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1790972605.694325:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d07d68800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790972605.694329:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790972605.694332:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877970397643264:0@lo:38:kworker.0 00000100:00100000:2.0:1790972605.695455:0:18585:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397642752:12345-0@lo:400:kworker.0 Request processed in 4843us (9843us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972605.695466:0:18585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1790972605.695505:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790972605.695511:0:17076:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790972605.696272:0:17086:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397642624 00000100:00100000:2.0:1790972605.696282:0:17086:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397642624 00000100:00100000:2.0:1790972605.696310:0:17086:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790972605.696317:0:17086:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877970397642624:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790972605.696337:0:17086:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790972605.696396:0:17086:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877970397642624:12345-0@lo:38:kworker.0 Request processed in 79us (10573us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790972605.696403:0:17086:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1790972605.696441:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e06810000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790972605.696446:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790972605.696450:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397642624:0@lo:38:kworker.0 00010000:00080000:0.0:1790972605.704743:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff888e3fa03800 x1877970397643136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972605.704772:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877970397643136:0@lo:400:kworker.0 00000100:00100000:0.0:1790972605.704793:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397642752:0@lo:400:kworker.0 00000100:00100000:1.0:1790972605.720769:0:17079:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877970397642880:12345-0@lo:38:kworker.0 Request processed in 27679us (34877us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790972605.720784:0:17079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1790972605.720845:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e3ac88800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790972605.720851:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790972605.720878:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877970397642880:0@lo:38:kworker.0 00010000:00010000:0.0:1790972606.068748:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790972606.072613:0:17831:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790972606.202383:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397643520:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790972606.202453:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972606.202788:0:18588:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397643520 00000100:00100000:3.0:1790972606.202798:0:18588:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397643520 00000100:00100000:3.0:1790972606.202868:0:18588:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790972606.202877:0:18588:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397643520:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790972606.202910:0:18588:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790972606.202972:0:18588:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397643520:12345-0@lo:13:osp-pre-0-1.0 Request processed in 96us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972606.202979:0:18588:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790972606.203121:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397643520:0@lo:13:osp-pre-0-1.0 00000020:01000004:1.0:1790972606.796195:0:20852:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790972606.827736:0:20852:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1790972606.827894:0:20852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a1119a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a111a1 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.827910:0:20852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a1119a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a111a1 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.827917:0:20852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a1119a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a111a1 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.827923:0:20852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a1119a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a111a1 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.827986:0:20852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790972606.827991:0:20852:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790972606.828018:0:20852:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790972606.828022:0:20852:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790972606.828028:0:20852:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790972606.828034:0:20852:0:(import.c:65:import_set_state_nolock()) ffff888e3ac88800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1790972606.828038:0:20852:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790972606.828052:0:20852:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790972606.828055:0:20852:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790972606.830184:0:20852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6200/0xd61f4faa13a110f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11100 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.830202:0:20852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6200/0xd61f4faa13a110f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11100 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.830210:0:20852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6200/0xd61f4faa13a110f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a11100 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.830217:0:20852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888d07bb6200/0xd61f4faa13a110f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a11100 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.832538:0:20105:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790972606.832553:0:20105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a1119a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a111a1 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.832564:0:20105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad42800 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:2.0:1790972606.832568:0:20105:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a1119a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a111a1 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.832578:0:20105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a1119a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a111a1 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790972606.832607:0:20105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a1119a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a111a1 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972606.832613:0:20105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790972606.832616:0:20105:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790972606.832619:0:20105:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790972606.833092:0:20852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790972606.833105:0:20852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42600/0xd61f4faa13a113ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a113f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.833113:0:20852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42600/0xd61f4faa13a113ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a113f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.833119:0:20852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42600/0xd61f4faa13a113ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a113f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.833126:0:20852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888e3ad42600/0xd61f4faa13a113ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a113f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833214:0:20105:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a1119a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a111a1 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833221:0:20105:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790972606.833253:0:20105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a1119a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a111a1 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833260:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a1119a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a111a1 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833275:0:20105:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790972606.833279:0:20105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888d07bb6200/0xd61f4faa13a110f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a11100 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833285:0:20105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb6200 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:2.0:1790972606.833288:0:20105:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb6200/0xd61f4faa13a110f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a11100 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833295:0:20105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888d07bb6200/0xd61f4faa13a110f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a11100 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790972606.833302:0:20105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb6200/0xd61f4faa13a110f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a11100 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972606.833317:0:20105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790972606.833320:0:20105:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1790972606.833336:0:20105:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888d07bb6200/0xd61f4faa13a110f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a11100 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833342:0:20105:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790972606.833349:0:20105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888d07bb6200/0xd61f4faa13a110f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a11100 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833356:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888d07bb6200/0xd61f4faa13a110f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a11100 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833366:0:20105:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972606.833369:0:20105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3ad42600/0xd61f4faa13a113ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a113f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833375:0:20105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad42600 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:2.0:1790972606.833377:0:20105:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad42600/0xd61f4faa13a113ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a113f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833383:0:20105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3ad42600/0xd61f4faa13a113ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a113f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790972606.833389:0:20105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad42600/0xd61f4faa13a113ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a113f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972606.833394:0:20105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1790972606.833396:0:20105:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1790972606.833407:0:20105:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3ad42600/0xd61f4faa13a113ed lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a113f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833420:0:20105:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790972606.833449:0:20105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3ad42600/0xd61f4faa13a113ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a113f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.833458:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972606.833460:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972606.833505:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5da60518-8817-4c86-8417-ee73ae6d3f86:3638:1877970397643648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790972606.833579:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972606.833625:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790972606.833631:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5da60518-8817-4c86-8417-ee73ae6d3f86:3638:1877970397643776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790972606.833652:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972606.833701:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397643648 00000100:00100000:3.0:1790972606.833708:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397643648 00000100:00100000:3.0:1790972606.833737:0:17066:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397643776 00000100:00100000:3.0:1790972606.833740:0:17066:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397643776 00000100:00100000:3.0:1790972606.833769:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790972606.833784:0:17066:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3638:x1877970397643648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1790972606.833791:0:17066:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790972606 with bad export cookie 15429138440286965701 00010000:00010000:1.0:1790972606.837026:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790972606.837062:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5da60518-8817-4c86-8417-ee73ae6d3f86:3640:1877970397643904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790972606.837142:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972606.837206:0:17067:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397643904 00000100:00100000:1.0:1790972606.837214:0:17067:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397643904 00000100:00100000:1.0:1790972606.837248:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790972606.837255:0:17067:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3638:x1877970397643776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790972606.837261:0:17067:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790972606 with bad export cookie 15429138440286965701 00000100:00100000:1.0:1790972606.837319:0:17067:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3638:x1877970397643776:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (3665us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790972606.837327:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790972606.837346:0:17067:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790972606.837350:0:17067:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1877970397643904:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1790972606.837355:0:17067:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790972606 with bad export cookie 15429138440286965701 00000100:00100000:1.0:1790972606.837384:0:17067:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3640:x1877970397643904:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (242us total) trans 0 rc -107/-107 00000100:00100000:1.0:1790972606.837390:0:17067:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1790972606.837423:0:3640:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790972606.837427:0:3640:0:(import.c:65:import_set_state_nolock()) ffff888e3d6d8800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1790972606.837446:0:3640:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1790972606.837736:0:20852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790972606.837749:0:20852:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3ad42600/0xd61f4faa13a113ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a113f4 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972606.837790:0:20852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1790972606.837802:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972606.837814:0:20852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d06bdda00/0xd61f4faa13a11591 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11598 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.837822:0:20852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d06bdda00/0xd61f4faa13a11591 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11598 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.837829:0:20852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d06bdda00/0xd61f4faa13a11591 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a11598 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.837836:0:20852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888d06bdda00/0xd61f4faa13a11591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a11598 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.837861:0:20852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790972606.837867:0:20852:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7c00/0xd61f4faa13a110eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a110f2 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.837873:0:20852:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7c00/0xd61f4faa13a110eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a110f2 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.837879:0:20852:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7c00/0xd61f4faa13a110eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a110f2 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.837885:0:20852:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888d07bb7c00/0xd61f4faa13a110eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a110f2 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.837893:0:20852:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1790972606.837895:0:20852:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1790972606.837903:0:20852:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00010000:00010000:0.0:1790972606.837936:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790972606.837941:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888d06bdda00/0xd61f4faa13a11591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a11598 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.837948:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdda00 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:0.0:1790972606.837952:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888d06bdda00/0xd61f4faa13a11591 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a11598 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.837960:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888d06bdda00/0xd61f4faa13a11591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a11598 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790972606.837968:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888d06bdda00/0xd61f4faa13a11591 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a11598 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972606.837972:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790972606.837975:0:17069:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790972606.837977:0:17069:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:3.0:1790972606.841231:0:17066:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3638:x1877970397643648:12345-0@lo:103:ldlm_bl.0 Request processed in 7441us (7646us total) trans 0 rc -107/-107 00000100:00100000:3.0:1790972606.841243:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1790972606.841343:0:20105:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972606.841352:0:20105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888d07bb7c00/0xd61f4faa13a110eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a110f2 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.841361:0:20105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb7c00 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:2.0:1790972606.841366:0:20105:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb7c00/0xd61f4faa13a110eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a110f2 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.841376:0:20105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888d07bb7c00/0xd61f4faa13a110eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a110f2 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790972606.841384:0:20105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb7c00/0xd61f4faa13a110eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a110f2 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972606.841389:0:20105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1790972606.841392:0:20105:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1790972606.841395:0:20105:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:3.0:1790972606.851694:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.139@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790972606.862148:0:3640:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.139@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1790972606.862155:0:3640:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790972606.862165:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e3d523480 x1877970397642496/t0(0) o400->MGC192.168.203.139@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790972621 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972606.862197:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e3d521c00 x1877970397643648/t0(0) o103->MGC192.168.203.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790972622 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972606.862227:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e3d520700 x1877970397643776/t0(0) o103->MGC192.168.203.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790972622 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972606.862236:0:3640:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e3d522300 x1877970397643904/t0(0) o103->MGC192.168.203.139@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790972622 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790972606.862245:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790972606.862247:0:3640:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790972606.862248:0:3640:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1790972606.862423:0:17069:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888d06bdda00/0xd61f4faa13a11591 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a11598 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.862443:0:17069:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790972606.862459:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888d06bdda00/0xd61f4faa13a11591 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a11598 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.862467:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888d06bdda00/0xd61f4faa13a11591 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a11598 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972606.862486:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972606.862488:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972606.862490:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790972606.862513:0:20852:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1790972606.862522:0:20852:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1790972606.862527:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790972606.862532:0:20852:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1790972606.862538:0:20852:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff888d07d6f000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790972606.865912:0:20852:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff888d05df9000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790972606.865918:0:20852:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff888d078f19c0) has exports, disconnecting them 00000020:00080000:0.0:1790972606.865923:0:20852:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff888d07d6f000), last request at 1790972605 00000020:00000080:0.0:1790972606.865931:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a113df 00000100:00080000:0.0:1790972606.865957:0:20852:0:(import.c:65:import_set_state_nolock()) ffff888d07d6e800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790972606.866020:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790972606.866035:0:20852:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888d07d6f000): rc 0 00000020:00000080:0.0:1790972606.866037:0:20852:0:(genops.c:885:class_export_put()) final put ffff888d07d6f000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1790972606.866051:0:20852:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff888d05df9000), last request at 1790972605 00000020:00000080:0.0:1790972606.866054:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1127a 00000100:00080000:0.0:1790972606.866062:0:20852:0:(import.c:65:import_set_state_nolock()) ffff888d05dff800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1790972606.866073:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1790972606.866079:0:20852:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888d05df9000): rc 0 00000020:00000080:0.0:1790972606.866081:0:20852:0:(genops.c:885:class_export_put()) final put ffff888d05df9000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1790972606.866089:0:20852:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9f73c1d07ae0 00000100:00080000:0.0:1790972606.866110:0:20852:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790972606.866119:0:20852:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff888e3a7d2300 x1877970397640448/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1790972612 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972606.866142:0:20852:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790972606.867251:0:20852:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790972606.867261:0:20852:0:(import.c:65:import_set_state_nolock()) ffff888e06810000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1790972606.867427:0:20852:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1790972606.867508:0:20852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1790972606.867523:0:20852:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790972606.867732:0:20852:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1790972606.867756:0:20852:0:(import.c:65:import_set_state_nolock()) ffff888e26a1c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1790972606.868529:0:20852:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1790972606.868532:0:20852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1790972606.868547:0:20852:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1790972606.868604:0:20852:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1790972606.868620:0:20852:0:(import.c:65:import_set_state_nolock()) ffff888e060ff000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1790972606.868657:0:20852:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff888d078f19c0) has no exports 00000100:00100000:0.0:1790972606.869991:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5da60518-8817-4c86-8417-ee73ae6d3f86:0:1877970397644032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790972606.870015:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5da60518-8817-4c86-8417-ee73ae6d3f86:3641:1877970397642496:0@lo:400:kworker.0 00010000:00010000:2.0:1790972606.871563:0:20105:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888d07bb7c00/0xd61f4faa13a110eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a110f2 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.871579:0:20105:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790972606.871597:0:20105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888d07bb7c00/0xd61f4faa13a110eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a110f2 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.871621:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888d07bb7c00/0xd61f4faa13a110eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd61f4faa13a110f2 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972606.871643:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972606.871645:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972606.871649:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790972606.872568:0:3638:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff888e3d6d8800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1790972606.872597:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397640448:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790972606.872625:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790972606.872631:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5da60518-8817-4c86-8417-ee73ae6d3f86:0:1877970397644416:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790972606.872750:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972606.873898:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5da60518-8817-4c86-8417-ee73ae6d3f86:3638:1877970397643648:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790972606.873924:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5da60518-8817-4c86-8417-ee73ae6d3f86:3638:1877970397643776:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1790972606.874985:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888d07d6f000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1790972606.875038:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888d05df9000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1790972606.875062:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d07d6e800 for lustre-MDT0001 00000020:00000080:0.0:1790972606.875065:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d05dff800 for lustre-MDT0001 00000100:00080000:1.0:1790972606.886837:0:3640:0:(import.c:65:import_set_state_nolock()) ffff888e3d6d8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790972606.886862:0:3640:0:(import.c:545:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1790972606.886878:0:3640:0:(import.c:666:import_select_connection()) MGC192.168.203.139@tcp: import ffff888e3d6d8800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1790972606.886904:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397644160:0@lo:9:umount.0 00000100:00100000:1.0:1790972606.886977:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972606.887116:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397644288:0@lo:9:umount.0 00000100:00100000:1.0:1790972606.887143:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972606.888133:0:3640:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa03800 x1877970397644544/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790972606.888165:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5da60518-8817-4c86-8417-ee73ae6d3f86:3640:1877970397643904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790972606.889103:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5da60518-8817-4c86-8417-ee73ae6d3f86:3637:1877970397644544:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1790972606.889142:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877970397644544 offset 0 length 520: 4 00000100:00100000:2.0:1790972606.889485:0:19023:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397644160 00000100:00100000:2.0:1790972606.889494:0:19023:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397644160 00000100:00100000:2.0:1790972606.889550:0:19023:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397644288 00000100:00100000:2.0:1790972606.889554:0:19023:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397644288 00000100:00100000:2.0:1790972606.889577:0:19023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790972606.889586:0:19023:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1877970397644160:12345-0@lo:9:umount.0 00000020:00000080:2.0:1790972606.889611:0:19023:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a112a4 00000100:00080000:2.0:1790972606.889620:0:19023:0:(import.c:65:import_set_state_nolock()) ffff888d07dc2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790972606.889694:0:19023:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1790972606.889867:0:18587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790972606.889877:0:18587:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1877970397644288:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790972606.889891:0:18587:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11410 00000100:00080000:0.0:1790972606.889898:0:18587:0:(import.c:65:import_set_state_nolock()) ffff888e3d4bc000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790972606.889928:0:18587:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1790972606.890054:0:18587:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05488a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+2:3637:x1877970397644288:12345-0@lo:9:umount.0 Request processed in 179us (2909us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972606.890062:0:18587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790972606.890168:0:19023:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05489c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3637:x1877970397644160:12345-0@lo:9:umount.0 Request processed in 583us (3191us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972606.890175:0:19023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:2.0:1790972606.890196:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972606.890201:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790972606.890497:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e26a1c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790972606.890557:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790972606.890940:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790972606.890947:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397644160:0@lo:9:umount.0 00000100:00080000:1.0:1790972606.890965:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e060ff000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1790972606.890981:0:3637:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1790972606.890982:0:3637:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790972606.890985:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397644288:0@lo:9:umount.0 00000020:00080000:0.0:1790972606.898946:0:20852:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff888d078f19c0) has no exports 00000020:01000000:1.0:1790972606.942243:0:20852:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff888d07df0a20 - data ffff888e0216c510/ffff888d01c85800 00000020:01000000:1.0:1790972606.942396:0:20852:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff888d07a9a480 - data ffff888e1e1e5000/ffff888e2d31bc00 00000001:00000004:1.0:1790972606.954978:0:20852:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1790972607.012546:0:20852:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790972607.012555:0:20852:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790972607.012562:0:20852:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1790972607.018206:0:20852:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790972607.018214:0:20852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1790972607.018234:0:20852:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790972607.018237:0:20852:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1790972607.022074:0:17819:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1790972607.022083:0:17819:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1790972607.022099:0:17819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1790972607.025488:0:20852:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790972607.025496:0:20852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1790972607.025517:0:20852:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790972607.025519:0:20852:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1790972607.026181:0:17821:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1790972607.026186:0:17821:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:2.0:1790972607.026196:0:17821:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1790972607.029636:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1110e 00000020:00000080:1.0:1790972607.029649:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e3ad0c800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790972607.030059:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ad0c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1790972607.030532:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11123 00000020:00000080:1.0:1790972607.030539:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e3ad0b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1790972607.030555:0:20852:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1790972607.030562:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790972607.030571:0:20852:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790972607.030576:0:20852:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff888d078f3380) has no exports 00000004:01000000:1.0:1790972607.030767:0:20852:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1790972607.030776:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11177 00000020:00000080:1.0:1790972607.030781:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e26a18800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1790972607.030786:0:20852:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1790972607.030789:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790972607.030794:0:20852:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790972607.030797:0:20852:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff888e2d0f19c0) has no exports 00000020:00000080:1.0:1790972607.030802:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11170 00000020:00000080:1.0:1790972607.030805:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e3ad0c000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790972607.031486:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ad0b000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1790972607.031509:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e26a18800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1790972607.031513:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ad0c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1790972607.032707:0:20852:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1790972607.032714:0:20852:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790972607.032718:0:20852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1790972607.032727:0:20852:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790972607.032729:0:20852:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790972607.032773:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790972607.032792:0:20852:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790972607.032801:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11162 00000020:00000080:1.0:1790972607.032810:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e3ad0e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1790972607.032815:0:20852:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1790972607.033270:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e060ff000 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1790972607.033279:0:38:0:(genops.c:885:class_export_put()) final put ffff888e3ad0e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790972607.033282:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ad0e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1790972607.033288:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790972607.033373:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ad0e800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1790972607.035738:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790972607.035756:0:20852:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790972607.035761:0:20852:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff888e3d423380) has no exports 00000020:00000080:1.0:1790972607.035771:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11154 00000020:00000080:1.0:1790972607.035779:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e0e5dc800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790972607.036018:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e0e5dc800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1790972607.039640:0:20852:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1790972607.039649:0:20852:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790972607.039653:0:20852:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1790972607.040963:0:20852:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790972607.040969:0:20852:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790972607.041032:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790972607.041043:0:20852:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1790972607.041061:0:20852:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1790972607.041068:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11146 00000020:00000080:1.0:1790972607.041077:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e060fa800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1790972607.041083:0:20852:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1790972607.041091:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790972607.041096:0:20852:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790972607.041099:0:20852:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff888e169ab380) has no exports 00000020:00000080:1.0:1790972607.041107:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1113f 00000020:00000080:1.0:1790972607.041110:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e06811800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790972607.041697:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e26a1c800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1790972607.041706:0:38:0:(genops.c:885:class_export_put()) final put ffff888e352eb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790972607.041708:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e352eb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1790972607.041714:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790972607.041789:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e060fa800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1790972607.041795:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e06811800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1790972607.045087:0:20852:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1790972607.045096:0:20852:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790972607.045100:0:20852:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790972607.045109:0:20852:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790972607.045173:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790972607.045185:0:20852:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790972607.045213:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790972607.045216:0:20852:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790972607.045222:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e029b6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790972607.045226:0:20852:0:(genops.c:844:class_export_destroy()) destroying export ffff888e029b6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1790972607.045237:0:20852:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790972607.045399:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1112a 00000020:00000080:0.0:1790972607.045406:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e3ad0f800/lustre-MDD0001_UUID 00000020:01000000:0.0:1790972607.045411:0:20852:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1790972607.045415:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790972607.045420:0:20852:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790972607.045423:0:20852:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff888d078f4d40) has no exports 00000020:00000080:0.0:1790972607.045441:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790972607.045444:0:20852:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1790972607.045448:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11131 00000020:00000080:0.0:1790972607.045452:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e3ad09000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1790972607.045459:0:20852:0:(tgt_mount.c:187:server_put_mount()) put mount ffff888e352e8000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1790972607.045462:0:20852:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888e352e8000 2 00000020:01000004:0.0:1790972607.045466:0:20852:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff888e352e8000 from lustre-MDT0001 00000020:00000080:0.0:1790972607.045482:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790972607.045485:0:20852:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1790972607.045488:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e3ad0d800/lustre-MDT0001_UUID 00000020:00000080:0.0:1790972607.045490:0:20852:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ad0d800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1790972607.045497:0:20852:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1790972607.045550:0:20852:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1790972607.045553:0:20852:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1790972607.045556:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790972607.045560:0:20852:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790972607.045567:0:20852:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff888e3ac8b000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790972607.045572:0:20852:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff888e169a99c0) has exports, disconnecting them 00000020:00080000:0.0:1790972607.045576:0:20852:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff888e3ac8b000), last request at 1790972514 00000020:00000080:0.0:1790972607.045580:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a111af 00000020:00080000:0.0:1790972607.045590:0:20852:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888e3ac8b000): rc 0 00000020:00000080:0.0:1790972607.045594:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e3ac8b000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1790972607.046316:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e06810000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1790972607.046326:0:38:0:(genops.c:885:class_export_put()) final put ffff888e060f9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790972607.046329:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e060f9800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1790972607.046334:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1790972607.046427:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ad0f800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1790972607.046431:0:38:0:(genops.c:885:class_export_put()) final put ffff888e3ad0b800/lustre-MDD0001_UUID 00000020:00000080:2.0:1790972607.046433:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ad0b800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1790972607.046437:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1790972607.046545:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ad09000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1790972607.046550:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ac8b000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1790972607.046948:0:20852:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1790972607.046952:0:20852:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790972607.046966:0:20852:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790972607.046972:0:20852:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790972607.046993:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e3ac88800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1790972607.047141:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790972607.047148:0:20852:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1790972607.047152:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e3ac8e800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1790972607.047154:0:20852:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ac8e800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1790972607.047158:0:20852:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1790972607.047194:0:20852:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888e352e8000 1 00000020:00000080:2.0:1790972607.047199:0:20852:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a110d6 00000020:00000080:2.0:1790972607.047205:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e3aad2800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1790972607.047212:0:20852:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1790972607.047219:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3aad2800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1790972607.047227:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790972607.047232:0:20852:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790972607.047235:0:20852:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff888e3d424d40) has no exports 00010000:00010000:2.0:1790972607.220996:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790972607.288517:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790972607.288534:0:20852:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:2.0:1790972607.288542:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e352ee800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1790972607.288547:0:20852:0:(genops.c:844:class_export_destroy()) destroying export ffff888e352ee800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1790972607.288562:0:20852:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:2.0:1790972607.288910:0:20852:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff888e352ed800 00000020:01000000:2.0:1790972607.288937:0:20852:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1790972607.288942:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790972607.288947:0:20852:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790972607.288951:0:20852:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff888e3d81b380) has no exports 00000100:00100000:0.0:1790972607.289181:0:18547:0:(service.c:3206:ptlrpc_main()) mdt00_003: service thread [ffff888d06e69c00:18547] 3 exiting: rc = 0 00000100:00100000:3.0:1790972607.289418:0:20572:0:(service.c:3206:ptlrpc_main()) mdt00_004: service thread [ffff888d06a3dc00:20572] 4 exiting: rc = 0 00000100:00100000:3.0:1790972607.289532:0:17080:0:(service.c:3206:ptlrpc_main()) mdt00_001: service thread [ffff888e3accdc00:17080] 1 exiting: rc = 0 00000100:00100000:1.0:1790972607.289635:0:17081:0:(service.c:3206:ptlrpc_main()) mdt00_002: service thread [ffff888e3accde00:17081] 2 exiting: rc = 0 00000100:00100000:1.0:1790972607.289734:0:17079:0:(service.c:3206:ptlrpc_main()) mdt00_000: service thread [ffff888e169b8800:17079] 0 exiting: rc = 1 00000100:00100000:2.0:1790972607.290976:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.290987:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.290993:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.290999:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291027:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291031:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291037:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291042:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291048:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291053:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291262:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291403:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291409:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291415:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291422:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291427:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291433:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291438:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291444:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291450:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291455:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291461:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291466:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291472:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291477:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291483:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291490:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291496:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291502:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291507:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291512:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291518:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291523:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291529:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291534:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291538:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291544:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291549:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291555:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291570:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291576:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291582:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291820:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291829:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291835:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291840:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291856:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291861:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291866:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291871:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291876:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291881:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291886:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291891:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291897:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291902:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291907:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291913:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291920:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291926:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291931:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291937:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291943:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.291949:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972607.301542:0:17083:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff888e3acccc00:17083] 0 exiting: rc = 1 00000100:00100000:1.0:1790972607.301718:0:17084:0:(service.c:3206:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff888e3accd200:17084] 1 exiting: rc = 0 00000100:00100000:2.0:1790972607.302090:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302099:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302106:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302111:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302116:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302120:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302125:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302130:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302135:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302139:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302159:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302164:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302169:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302174:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302180:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302185:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302191:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302196:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302202:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302208:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302213:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302219:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302224:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302228:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302233:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302238:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302244:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302249:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302253:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302258:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302338:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302347:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302352:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302357:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302362:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302367:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302372:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302377:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302382:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302387:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302392:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302397:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302462:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302471:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302476:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302489:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302494:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302499:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302504:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302509:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302514:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302518:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302523:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302527:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302532:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302536:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302541:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302545:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302550:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302555:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302560:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302565:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302570:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.302577:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303160:0:17086:0:(service.c:3206:ptlrpc_main()) mdt_out00_001: service thread [ffff888e3d27e600:17086] 1 exiting: rc = 0 00000100:00100000:2.0:1790972607.303247:0:18145:0:(service.c:3206:ptlrpc_main()) mdt_out00_002: service thread [ffff888e1d7b6e00:18145] 2 exiting: rc = 0 00000100:00100000:1.0:1790972607.303373:0:17085:0:(service.c:3206:ptlrpc_main()) mdt_out00_000: service thread [ffff888e1715ee00:17085] 0 exiting: rc = 1 00000100:00100000:2.0:1790972607.303730:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303737:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303744:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303750:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303755:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303769:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303781:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303786:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303792:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303798:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303803:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303809:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303815:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303840:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303865:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303870:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303876:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303881:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303886:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303892:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303898:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303903:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303909:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303914:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303920:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303938:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303946:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303952:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303957:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303963:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303969:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303974:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303979:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303986:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303992:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.303998:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304004:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304024:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304031:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304037:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304043:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304048:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304053:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304059:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304065:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304071:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304077:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304083:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304089:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304116:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304123:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304130:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304137:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304143:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304149:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304155:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304161:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304167:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304174:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304179:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304185:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304191:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304198:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.304205:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790972607.318214:0:17087:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0000: service thread [ffff888e3d27ec00:17087] 0 exiting: rc = 1 00000100:00100000:0.0:1790972607.318388:0:17088:0:(service.c:3206:ptlrpc_main()) mdt_seqs_0001: service thread [ffff888e3d27e800:17088] 1 exiting: rc = 0 00000100:00100000:3.0:1790972607.318504:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318511:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318516:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318521:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318526:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318531:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318536:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318541:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318545:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318551:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318556:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318562:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318567:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318586:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318592:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318597:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318602:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318608:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318613:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318618:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318623:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318629:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318634:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318639:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318644:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318648:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318654:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318949:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318968:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318974:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318978:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318983:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318989:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318994:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.318999:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319003:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319008:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319013:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319018:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319023:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319028:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319034:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319038:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319043:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319049:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319054:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319059:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319065:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319079:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319084:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319089:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319094:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319100:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319105:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319110:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319116:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319121:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319126:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319131:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319136:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319141:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319146:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319151:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.319157:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790972607.319945:0:17090:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0001: service thread [ffff888e3d27e400:17090] 1 exiting: rc = 0 00000100:00100000:0.0:1790972607.320122:0:17089:0:(service.c:3206:ptlrpc_main()) mdt_seqm_0000: service thread [ffff888e3d27ea00:17089] 0 exiting: rc = 1 00000100:00100000:3.0:1790972607.320240:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320246:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320251:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320257:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320261:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320341:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320347:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320352:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320358:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320364:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320369:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320374:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320379:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320385:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320390:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320395:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320401:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320406:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320411:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320427:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320432:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320437:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320443:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320448:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320454:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320459:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320465:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320469:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320474:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320478:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320483:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320488:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320494:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320499:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320504:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320510:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320515:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320520:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320525:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320530:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320534:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320539:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320545:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320550:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320555:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320560:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320565:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320569:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320574:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320579:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320584:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320588:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320593:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320597:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320610:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320615:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320620:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320625:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320629:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320634:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320639:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320644:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320649:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.320654:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972607.321310:0:17092:0:(service.c:3206:ptlrpc_main()) mdt_fld_0001: service thread [ffff888e3d27f600:17092] 1 exiting: rc = 0 00000100:00100000:1.0:1790972607.321840:0:17091:0:(service.c:3206:ptlrpc_main()) mdt_fld_0000: service thread [ffff888e3d27f200:17091] 0 exiting: rc = 1 00000100:00100000:3.0:1790972607.321972:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322126:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322133:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322139:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322144:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322149:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322154:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322159:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322163:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322168:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322173:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322177:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322182:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322188:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322193:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322198:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322203:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322207:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322212:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322217:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322221:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322225:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322230:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322234:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322239:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322251:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322256:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322261:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322325:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322330:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322335:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322340:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322346:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322350:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322355:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322359:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322364:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322368:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322372:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322376:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322381:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322385:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322389:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322394:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322399:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322403:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322408:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322412:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322417:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322421:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322425:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322430:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322434:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322438:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322443:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322447:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322451:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322456:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322460:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322464:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322476:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322481:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322485:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.322490:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972607.323341:0:17093:0:(service.c:3206:ptlrpc_main()) mdt_io00_000: service thread [ffff888e3d27f800:17093] 0 exiting: rc = 1 00000100:00100000:3.0:1790972607.323853:0:17094:0:(service.c:3206:ptlrpc_main()) mdt_io00_001: service thread [ffff888e3d27fe00:17094] 1 exiting: rc = 0 00000100:00100000:1.0:1790972607.324194:0:17095:0:(service.c:3206:ptlrpc_main()) mdt_io00_002: service thread [ffff888e1715e600:17095] 2 exiting: rc = 0 00000100:00100000:3.0:1790972607.324368:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324375:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324381:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324387:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324394:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324400:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324407:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324412:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324418:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324423:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324429:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324435:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324441:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324447:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324454:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324461:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324467:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324474:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324480:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324486:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324492:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324514:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324521:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324526:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324532:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324537:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324543:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324549:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324554:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324560:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324572:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324578:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324584:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324590:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324595:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324601:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324607:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324612:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324618:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324623:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324628:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324635:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324640:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324646:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324650:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324702:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324710:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324714:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324720:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324725:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324731:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324736:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324741:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324748:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324753:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324758:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324762:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324767:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324772:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324777:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324783:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324790:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324795:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972607.324800:0:20852:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790972607.329409:0:20852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790972607.329432:0:20852:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1790972607.329438:0:20852:0:(genops.c:885:class_export_put()) final put ffff888e04b08000/MDS_uuid 00000020:00000080:3.0:1790972607.329443:0:20852:0:(genops.c:844:class_export_destroy()) destroying export ffff888e04b08000/MDS_uuid for MDS 00000020:01000000:3.0:1790972607.329449:0:20852:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1790972607.329580:0:20852:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1790972608.247864:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972609.271076:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972610.293024:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790972610.807148:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790972610.807157:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790972610.807160:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790972610.807164:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790972610.807167:0:38:0:(import.c:65:import_set_state_nolock()) ffff888d05dfe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790972610.807175:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 543 00000100:00080000:1.0:1790972610.807180:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790972610.807191:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff888d05dfe000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1790972610.807225:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e0548b480 x1877970397644672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790972610.807261:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790972610.807264:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790972610.807266:0:38:0:(import.c:65:import_set_state_nolock()) ffff888d07d68800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790972610.807269:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 543 00000100:00080000:1.0:1790972610.807272:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1790972610.807275:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff888d07d68800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1790972610.807283:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e05489880 x1877970397644928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790972610.807317:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877970397644672:0@lo:38:kworker.0 00000400:00000100:1.0:1790972610.807362:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877970397644672 offset 0 length 520: 4 00000100:00100000:1.0:1790972610.807412:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877970397644928:0@lo:38:kworker.0 00000400:00000100:1.0:1790972610.807426:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877970397644928 offset 0 length 520: 4 00000100:00100000:0.0:1790972610.808196:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877970397645056:0@lo:400:kworker.0 00000400:00000100:0.0:1790972610.808230:0:3640:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877970397645056 offset 0 length 224: 4 00000100:00100000:3.0:1790972610.809069:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877970397644800:0@lo:400:kworker.0 00000400:00000100:3.0:1790972610.809097:0:3639:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877970397644800 offset 0 length 224: 4 00000020:01000004:3.0:1790972611.152211:0:21053:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790972611.166797:0:21053:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1790972611.166864:0:21053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11250 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972611.166879:0:21053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11250 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972611.166887:0:21053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11249 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a11250 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972611.166894:0:21053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a11250 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972611.166915:0:21053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1790972611.166920:0:21053:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1790972611.166948:0:21053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790972611.166958:0:21053:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e0548b480 x1877970397644672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790972630 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972611.166975:0:21053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790972611.166980:0:21053:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790972611.166987:0:21053:0:(import.c:65:import_set_state_nolock()) ffff888d05dfe000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1790972611.166992:0:21053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790972611.167008:0:21053:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e0548b480 x1877970397644672/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790972630 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972611.167014:0:21053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790972611.167019:0:21053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:0.0:1790972611.168426:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790972611.168436:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a11250 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972611.168447:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb6c00 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:0.0:1790972611.168451:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11249 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a11250 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972611.168462:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a11250 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790972611.168477:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11249 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a11250 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972611.168482:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790972611.168485:0:17069:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790972611.168488:0:17069:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790972611.168501:0:17069:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff888e3d6d8800 00010000:00010000:0.0:1790972611.168505:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11249 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a11250 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972611.168512:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a11250 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972611.168523:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972611.168525:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972611.168526:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972611.169503:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877970397644672:0@lo:38:kworker.0 00000100:00080000:3.0:1790972611.172300:0:21053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790972611.172330:0:21053:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e05489180 x1877970397644800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972626 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972611.172351:0:21053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1790972611.172359:0:21053:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790972611.172386:0:21053:0:(import.c:65:import_set_state_nolock()) ffff888d05dfb800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1790972611.172735:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1877970397645184:0@lo:39:umount.0 00000400:00000100:0.0:1790972611.172790:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877970397645184 offset 0 length 224: 4 00000100:00100000:2.0:1790972611.173787:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877970397644800:0@lo:400:kworker.0 00010000:00010000:2.0:1790972611.317090:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790972611.829024:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790972611.829036:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790972611.829039:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1790972611.829043:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790972611.829254:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877970397645312:0@lo:400:kworker.0 00000400:00000100:0.0:1790972611.829314:0:3641:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877970397645312 offset 0 length 224: 4 00010000:00010000:2.0:1790972612.341046:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790972612.857944:0:19400:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1790972612.857954:0:19400:0:(genops.c:885:class_export_put()) final put ffff888e3d4bb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790972612.858032:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3d4bb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1790972612.858100:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e3d4bc000 for lustre-OST0001 00000001:00100000:1.0:1790972612.858354:0:18581:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1790972612.858368:0:18581:0:(genops.c:885:class_export_put()) final put ffff888e3ac1a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1790972612.858553:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3ac1a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1790972612.858589:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d07dc2000 for lustre-OST0000 00010000:00010000:0.0:1790972613.365118:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972614.390859:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972615.415128:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790972615.860868:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790972615.860879:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790972615.860882:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790972615.860886:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790972615.861010:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790972615.861033:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877970397645440:0@lo:400:kworker.0 00000400:00000100:2.0:1790972615.861087:0:3639:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877970397645440 offset 0 length 224: 4 00000100:00100000:0.0:1790972616.308818:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972606/real 1790972606] req@ffff888e3fa03800 x1877970397644544/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790972616 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972616.308877:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e3fa03800 x1877970397644544/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790972616 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790972616.308897:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e3d6d8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790972616.308923:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1790972616.308927:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5da60518-8817-4c86-8417-ee73ae6d3f86:3637:1877970397644544:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:1.0:1790972616.309025:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790972616.309031:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1790972616.309034:0:38:0:(import.c:65:import_set_state_nolock()) ffff888e3d6d8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790972616.309039:0:38:0:(import.c:545:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 544 00000100:00080000:1.0:1790972616.309043:0:38:0:(import.c:630:import_select_connection()) MGC192.168.203.139@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790972616.309053:0:38:0:(import.c:666:import_select_connection()) MGC192.168.203.139@tcp: import ffff888e3d6d8800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1790972616.309083:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e0548b480 x1877970397645568/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790972616.309110:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790972616.309115:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790972616.309204:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5da60518-8817-4c86-8417-ee73ae6d3f86:3637:1877970397645568:0@lo:250:kworker.0 00000400:00000100:0.0:1790972616.309249:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877970397645568 offset 0 length 520: 4 00000100:00100000:3.0:1790972616.309401:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790972616.309413:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877970397645696:0@lo:400:kworker.0 00000400:00000100:3.0:1790972616.309451:0:3638:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877970397645696 offset 0 length 224: 4 00010000:00010000:0.0:1790972616.438074:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972617.462126:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972618.485691:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972619.508811:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972620.532824:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972621.429456:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972611/real 1790972611] req@ffff888e3a7d2300 x1877970397645184/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790972621 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972621.429489:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e3a7d2300 x1877970397645184/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790972621 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790972621.429509:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d05dfb800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1790972621.429531:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1877970397645184:0@lo:39:umount.0 00000100:00080000:3.0:1790972621.430343:0:21053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790972621.430348:0:21053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1790972621.430353:0:21053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1790972621.431469:0:21053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7600/0xd61f4faa13a1121f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11226 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972621.431485:0:21053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7600/0xd61f4faa13a1121f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11226 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972621.431492:0:21053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7600/0xd61f4faa13a1121f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a11226 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972621.431499:0:21053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888d07bb7600/0xd61f4faa13a1121f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a11226 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972621.431523:0:21053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972621.431545:0:21053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7a00/0xd61f4faa13a11583 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1158a expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972621.431552:0:21053:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7a00/0xd61f4faa13a11583 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a1158a expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972621.431557:0:21053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7a00/0xd61f4faa13a11583 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a1158a expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972621.431562:0:21053:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888d07bb7a00/0xd61f4faa13a11583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a1158a expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972621.431576:0:21053:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1790972621.431580:0:21053:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1790972621.431604:0:21053:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1790972621.431608:0:21053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1790972621.431613:0:21053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790972621.431618:0:21053:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790972621.431623:0:21053:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff888e2d0f3380) has no exports 00000020:00080000:3.0:1790972621.431644:0:21053:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff888e2d0f3380) has no exports 00010000:00010000:0.0:1790972621.431895:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790972621.431902:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888d07bb7600/0xd61f4faa13a1121f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a11226 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972621.431909:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb7600 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:0.0:1790972621.431913:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb7600/0xd61f4faa13a1121f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a11226 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972621.431921:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888d07bb7600/0xd61f4faa13a1121f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a11226 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790972621.431936:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb7600/0xd61f4faa13a1121f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a11226 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972621.431942:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790972621.431944:0:17069:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1790972621.431946:0:17069:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1790972621.431959:0:17069:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff888e3d6d8800 00010000:00010000:0.0:1790972621.431963:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888d07bb7600/0xd61f4faa13a1121f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a11226 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972621.431970:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888d07bb7600/0xd61f4faa13a1121f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a11226 expref: -99 pid: 18580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972621.431982:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790972621.431985:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888d07bb7a00/0xd61f4faa13a11583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a1158a expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972621.431990:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb7a00 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:0.0:1790972621.431992:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb7a00/0xd61f4faa13a11583 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a1158a expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972621.431998:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888d07bb7a00/0xd61f4faa13a11583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a1158a expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790972621.432004:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb7a00/0xd61f4faa13a11583 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a1158a expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972621.432008:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790972621.432010:0:17069:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790972621.432017:0:17069:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790972621.432024:0:17069:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff888e3d6d8800 00010000:00010000:0.0:1790972621.432028:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888d07bb7a00/0xd61f4faa13a11583 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a1158a expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972621.432034:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888d07bb7a00/0xd61f4faa13a11583 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a1158a expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972621.432044:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972621.432045:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972621.432048:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972621.432770:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1790972621.438790:0:21053:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff888d01c67de0 - data ffff888e1e1e6438/ffff888e3a7f1000 00000020:01000000:3.0:1790972621.439098:0:21053:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff888d07df04e0 - data ffff888e1e051000/ffff888d06fd5800 00100000:10000000:1.0:1790972621.449763:0:21053:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790972621.466607:0:21053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11234 00000020:00000080:2.0:1790972621.466619:0:21053:0:(genops.c:885:class_export_put()) final put ffff888e028f0000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790972621.466635:0:21053:0:(tgt_mount.c:187:server_put_mount()) put mount ffff888d07d00000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790972621.466639:0:21053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888d07d00000 2 00000020:01000004:2.0:1790972621.466642:0:21053:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff888d07d00000 from lustre-OST0000 00000020:00000080:2.0:1790972621.466759:0:21053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790972621.466769:0:21053:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790972621.466772:0:21053:0:(genops.c:885:class_export_put()) final put ffff888e1f7ec000/lustre-OST0000_UUID 00000020:00000080:2.0:1790972621.466775:0:21053:0:(genops.c:844:class_export_destroy()) destroying export ffff888e1f7ec000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790972621.466781:0:21053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790972621.466830:0:21053:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790972621.466835:0:21053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790972621.466838:0:21053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790972621.466843:0:21053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790972621.466849:0:21053:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff888d05dfa800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790972621.466855:0:21053:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff888e169a8000) has exports, disconnecting them 00000020:00080000:2.0:1790972621.466860:0:21053:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff888d05dfa800), last request at 1790972528 00000020:00000080:2.0:1790972621.466864:0:21053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1125e 00000020:00080000:2.0:1790972621.466872:0:21053:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888d05dfa800): rc 0 00000020:00000080:2.0:1790972621.466877:0:21053:0:(genops.c:885:class_export_put()) final put ffff888d05dfa800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790972621.467356:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888e028f0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1790972621.467370:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888d05dfa800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1790972621.473577:0:21053:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1790972621.473586:0:21053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1790972621.473590:0:21053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790972621.473598:0:21053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790972621.473761:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d05dfe000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1790972621.473873:0:21053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790972621.473883:0:21053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1790972621.473902:0:21053:0:(genops.c:885:class_export_put()) final put ffff888e3d4b9000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1790972621.473906:0:21053:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3d4b9000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1790972621.473913:0:21053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1790972621.473980:0:21053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1790972621.473984:0:21053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790972621.473990:0:21053:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1790972621.473997:0:21053:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff888d05dfb000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1790972621.474003:0:21053:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff888d06958000) has exports, disconnecting them 00000020:00080000:3.0:1790972621.474007:0:21053:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff888d05dfb000), last request at 1790972528 00000020:00000080:3.0:1790972621.474011:0:21053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11273 00000020:00080000:3.0:1790972621.474025:0:21053:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888d05dfb000): rc 0 00000020:00000080:3.0:1790972621.474029:0:21053:0:(genops.c:885:class_export_put()) final put ffff888d05dfb000/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1790972621.474126:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888d05dfb000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1790972621.490488:0:21053:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790972621.490497:0:21053:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790972621.490501:0:21053:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790972621.490508:0:21053:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1790972621.490535:0:471:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d05dfb800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1790972621.490711:0:21053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790972621.490719:0:21053:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1790972621.490725:0:21053:0:(genops.c:885:class_export_put()) final put ffff888d05dfc800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1790972621.490728:0:21053:0:(genops.c:844:class_export_destroy()) destroying export ffff888d05dfc800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1790972621.490734:0:21053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1790972621.490806:0:21053:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888d07d00000 1 00000020:00000080:0.0:1790972621.490813:0:21053:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11211 00000020:00000080:0.0:1790972621.490819:0:21053:0:(genops.c:885:class_export_put()) final put ffff888d07d02000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1790972621.490827:0:21053:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1790972621.490835:0:471:0:(genops.c:844:class_export_destroy()) destroying export ffff888d07d02000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1790972621.490844:0:21053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790972621.490849:0:21053:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790972621.490866:0:21053:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff888e2d0f0000) has no exports 00010000:00010000:2.0:1790972621.563230:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790972621.564603:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790972621.564611:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790972621.564614:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790972621.564618:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790972621.564699:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877970397645824:0@lo:400:kworker.0 00000400:00000100:0.0:1790972621.564757:0:3640:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877970397645824 offset 0 length 224: 4 00000020:00000080:3.0:1790972621.665769:0:21053:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790972621.665783:0:21053:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1790972621.665788:0:21053:0:(genops.c:885:class_export_put()) final put ffff888d07d02800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1790972621.665793:0:21053:0:(genops.c:844:class_export_destroy()) destroying export ffff888d07d02800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1790972621.665804:0:21053:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1790972621.665920:0:21053:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff888d07d06800 00000020:02000400:3.0:1790972621.665972:0:21053:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1790972622.581240:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972623.606480:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972624.630504:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1790972625.545183:0:21256:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1790972625.560909:0:21256:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1790972625.560991:0:21256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43200/0xd61f4faa13a113ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a113b5 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972625.561006:0:21256:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43200/0xd61f4faa13a113ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a113b5 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972625.561014:0:21256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43200/0xd61f4faa13a113ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a113b5 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972625.561021:0:21256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888e3ad43200/0xd61f4faa13a113ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a113b5 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972625.561045:0:21256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1790972625.561050:0:21256:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1790972625.561072:0:21256:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790972625.561083:0:21256:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e05489880 x1877970397644928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790972630 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972625.561116:0:21256:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790972625.561122:0:21256:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790972625.561128:0:21256:0:(import.c:65:import_set_state_nolock()) ffff888d07d68800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1790972625.561133:0:21256:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790972625.561137:0:21256:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e05489880 x1877970397644928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790972630 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972625.561144:0:21256:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790972625.561147:0:21256:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00010000:00010000:2.0:1790972625.561189:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972625.561202:0:17069:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3ad43200/0xd61f4faa13a113ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a113b5 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972625.561210:0:17069:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad43200 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:2.0:1790972625.561213:0:17069:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad43200/0xd61f4faa13a113ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a113b5 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972625.561222:0:17069:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3ad43200/0xd61f4faa13a113ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a113b5 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790972625.561229:0:17069:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad43200/0xd61f4faa13a113ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a113b5 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972625.561235:0:17069:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790972625.561238:0:17069:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790972625.561240:0:17069:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790972625.561255:0:17069:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff888e3d6d8800 00010000:00010000:2.0:1790972625.561258:0:17069:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3ad43200/0xd61f4faa13a113ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a113b5 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972625.561264:0:17069:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3ad43200/0xd61f4faa13a113ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a113b5 expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972625.561275:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972625.561276:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972625.561278:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972625.561530:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05489880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877970397644928:0@lo:38:kworker.0 00000100:00080000:0.0:1790972625.562470:0:21256:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790972625.562479:0:21256:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e05488e00 x1877970397645056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972626 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972625.562498:0:21256:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e3d523100 x1877970397645312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972627 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972625.562517:0:21256:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e05489180 x1877970397645440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972631 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972625.562538:0:21256:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e0548a300 x1877970397645696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972632 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972625.562550:0:21256:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e3fa03800 x1877970397645824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972637 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972625.562558:0:21256:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1790972625.562562:0:21256:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1790972625.562584:0:21256:0:(import.c:65:import_set_state_nolock()) ffff888e3d4be800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1790972625.562689:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877970397645824:0@lo:400:kworker.0 00000100:00100000:2.0:1790972625.562698:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05488e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877970397645056:0@lo:400:kworker.0 00000100:00100000:3.0:1790972625.563082:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3639:1877970397645440:0@lo:400:kworker.0 00000100:00100000:3.0:1790972625.563107:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877970397645696:0@lo:400:kworker.0 00000100:00100000:3.0:1790972625.563125:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1877970397645952:0@lo:39:umount.0 00000400:00000100:3.0:1790972625.563170:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877970397645952 offset 0 length 224: 4 00000100:00100000:1.0:1790972625.565852:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d523100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877970397645312:0@lo:400:kworker.0 00010000:00010000:0.0:1790972625.652896:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790972626.677968:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790972626.677977:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1790972626.678149:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972627.701825:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972628.724852:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972629.749070:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972630.772864:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972631.732821:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972616/real 1790972616] req@ffff888e0548b480 x1877970397645568/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790972631 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972631.732914:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e0548b480 x1877970397645568/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1790972631 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790972631.732936:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e3d6d8800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790972631.732956:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1790972631.732960:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5da60518-8817-4c86-8417-ee73ae6d3f86:3637:1877970397645568:0@lo:250:kworker.0 00000100:00080000:0.0:1790972631.733067:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790972631.733072:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1790972631.733075:0:38:0:(import.c:65:import_set_state_nolock()) ffff888e3d6d8800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972631.733080:0:38:0:(import.c:545:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 554 00000100:00080000:0.0:1790972631.733085:0:38:0:(import.c:630:import_select_connection()) MGC192.168.203.139@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790972631.733096:0:38:0:(import.c:666:import_select_connection()) MGC192.168.203.139@tcp: import ffff888e3d6d8800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972631.733136:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa01880 x1877970397646080/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790972631.733189:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5da60518-8817-4c86-8417-ee73ae6d3f86:3637:1877970397646080:0@lo:250:kworker.0 00000400:00000100:3.0:1790972631.733244:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877970397646080 offset 0 length 520: 4 00010000:00010000:0.0:1790972631.796969:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972632.820924:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972633.847367:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972634.869400:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972635.829191:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972625/real 1790972625] req@ffff888e3fa01f80 x1877970397645952/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790972635 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972635.829224:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e3fa01f80 x1877970397645952/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1790972635 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790972635.829245:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e3d4be800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790972635.829307:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1877970397645952:0@lo:39:umount.0 00000100:00080000:0.0:1790972635.831468:0:21256:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1790972635.831476:0:21256:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1790972635.831483:0:21256:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1790972635.833187:0:21256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6600/0xd61f4faa13a11384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1138b expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972635.833381:0:21256:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6600/0xd61f4faa13a11384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a1138b expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972635.833388:0:21256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6600/0xd61f4faa13a11384 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a1138b expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972635.833395:0:21256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888d07bb6600/0xd61f4faa13a11384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a1138b expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972635.833488:0:21256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790972635.833499:0:21256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7200/0xd61f4faa13a11575 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1157c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972635.833569:0:21256:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7200/0xd61f4faa13a11575 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a1157c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972635.833576:0:21256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb7200/0xd61f4faa13a11575 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a1157c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972635.833582:0:21256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.139@tcp lock: ffff888d07bb7200/0xd61f4faa13a11575 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd61f4faa13a1157c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972635.833841:0:20105:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790972635.833849:0:20105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888d07bb6600/0xd61f4faa13a11384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a1138b expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972635.833856:0:20105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb6600 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:2.0:1790972635.833861:0:20105:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb6600/0xd61f4faa13a11384 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a1138b expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972635.833870:0:20105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888d07bb6600/0xd61f4faa13a11384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a1138b expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790972635.833877:0:20105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb6600/0xd61f4faa13a11384 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a1138b expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972635.833883:0:20105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790972635.833885:0:20105:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:2.0:1790972635.833896:0:20105:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff888e3d6d8800 00010000:00010000:2.0:1790972635.833899:0:20105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888d07bb6600/0xd61f4faa13a11384 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a1138b expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972635.833905:0:20105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888d07bb6600/0xd61f4faa13a11384 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a1138b expref: -99 pid: 19399 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972635.833921:0:20105:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972635.833924:0:20105:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888d07bb7200/0xd61f4faa13a11575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a1157c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972635.833940:0:20105:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb7200 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:2.0:1790972635.833958:0:20105:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb7200/0xd61f4faa13a11575 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd61f4faa13a1157c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972635.833965:0:20105:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888d07bb7200/0xd61f4faa13a11575 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a1157c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790972635.833971:0:20105:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb7200/0xd61f4faa13a11575 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a1157c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972635.833976:0:20105:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1790972635.833978:0:20105:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1790972635.833983:0:20105:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff888e3d6d8800 00010000:00010000:2.0:1790972635.833986:0:20105:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888d07bb7200/0xd61f4faa13a11575 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a1157c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972635.833994:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972635.833995:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972635.833997:0:20105:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972635.834216:0:21256:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790972635.834229:0:21256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888d07bb7200/0xd61f4faa13a11575 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a1157c expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972635.834246:0:21256:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1790972635.834251:0:21256:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1790972635.834253:0:21256:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1790972635.834306:0:21256:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1790972635.834310:0:21256:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1790972635.834316:0:21256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790972635.834321:0:21256:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1790972635.834325:0:21256:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff888d0695cd40) has no exports 00000020:00080000:0.0:1790972635.834349:0:21256:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff888d0695cd40) has no exports 00010000:00010000:2.0:1790972635.836774:0:17069:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1790972635.838815:0:21256:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff888d01c67d80 - data ffff888e1e1e6e58/ffff888e3a7f2800 00000020:01000000:0.0:1790972635.839152:0:21256:0:(lprocfs_status_server.c:369:lprocfs_free_client_stats()) stat ffff888d01c67ea0 - data ffff888d060aaa20/ffff888e3fa1f800 00100000:10000000:0.0:1790972635.852807:0:21256:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1790972635.874343:0:21256:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a11399 00000020:00000080:1.0:1790972635.874354:0:21256:0:(genops.c:885:class_export_put()) final put ffff888d05dfd800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1790972635.877026:0:21256:0:(tgt_mount.c:187:server_put_mount()) put mount ffff888d07dc7800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1790972635.877036:0:21256:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888d07dc7800 2 00000020:01000004:1.0:1790972635.877039:0:21256:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff888d07dc7800 from lustre-OST0001 00000020:00000080:1.0:1790972635.877072:0:21256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790972635.877082:0:21256:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1790972635.877101:0:21256:0:(genops.c:885:class_export_put()) final put ffff888e3d4bf000/lustre-OST0001_UUID 00000020:00000080:1.0:1790972635.877104:0:21256:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3d4bf000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1790972635.877115:0:21256:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1790972635.877244:0:21256:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5da60518-8817-4c86-8417-ee73ae6d3f86->MGS 00010000:00010000:1.0:1790972635.877261:0:21256:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888d07bb6a00/0xd61f4faa13a110dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a110e4 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790972635.877275:0:21256:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888d07bb6a00/0xd61f4faa13a110dd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a110e4 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790972635.877282:0:21256:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1790972635.877284:0:21256:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1790972635.877287:0:21256:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1790972635.877301:0:21256:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff888e3d6d8800 00010000:00010000:1.0:1790972635.877305:0:21256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888d07bb6a00/0xd61f4faa13a110dd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a110e4 expref: -99 pid: 17810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972635.877321:0:21256:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3ad43e00/0xd61f4faa13a10fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd61f4faa13a10fd3 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790972635.877327:0:21256:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad43e00/0xd61f4faa13a10fcc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd61f4faa13a10fd3 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790972635.877332:0:21256:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790972635.877334:0:21256:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1790972635.877336:0:21256:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1790972635.877344:0:21256:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff888e3d6d8800 00010000:00010000:1.0:1790972635.877347:0:21256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3ad43e00/0xd61f4faa13a10fcc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd61f4faa13a10fd3 expref: -99 pid: 17059 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1790972635.877362:0:21256:0:(import.c:65:import_set_state_nolock()) ffff888e3d6d8800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1790972635.877372:0:21256:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1790972635.877374:0:21256:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1790972635.877376:0:21256:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1790972635.877381:0:21256:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1790972635.877393:0:21256:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff888e3fa01880 x1877970397646080/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790972651 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1790972635.877410:0:21256:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790972635.877413:0:21256:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:1.0:1790972635.877446:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5da60518-8817-4c86-8417-ee73ae6d3f86:3637:1877970397646080:0@lo:250:kworker.0 10000000:01000000:1.0:1790972635.877472:0:21256:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790972635.877480:0:21256:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a10fb7 00000020:00000080:1.0:1790972635.877486:0:21256:0:(genops.c:885:class_export_put()) final put ffff888e04b0d000/5da60518-8817-4c86-8417-ee73ae6d3f86 00000020:00000080:0.0:1790972635.880657:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888d05dfd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1790972635.880752:0:21256:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.139@tcp (flags='') 00000020:00000080:1.0:1790972635.880762:0:21256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790972635.880769:0:21256:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.139@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790972635.880773:0:21256:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff888e3d040000) has no exports 00000020:00000080:0.0:1790972635.880847:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e04b0d000/5da60518-8817-4c86-8417-ee73ae6d3f86 for MGC192.168.203.139@tcp 10000000:01000000:3.0:1790972635.893889:0:17077:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1790972635.894015:0:21256:0:(obd_class.h:668:obd_cleanup_client_import()) MGC192.168.203.139@tcp: client import never connected 00000100:00080000:1.0:1790972635.894020:0:21256:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1790972635.894024:0:21256:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1790972635.894027:0:21256:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1790972635.894030:0:21256:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1790972635.894123:0:21256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790972635.894132:0:21256:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.139@tcp (uuid 5da60518-8817-4c86-8417-ee73ae6d3f86) 00000020:01000000:1.0:1790972635.894140:0:21256:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1790972635.894148:0:21256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790972635.894153:0:21256:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790972635.894161:0:21256:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff888d07d6c000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790972635.894168:0:21256:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff888d010dcd40) has exports, disconnecting them 00000020:00080000:1.0:1790972635.894172:0:21256:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff888d07d6c000), last request at 1790972554 00000020:00000080:1.0:1790972635.894177:0:21256:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a113c3 00000020:00080000:1.0:1790972635.894193:0:21256:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888d07d6c000): rc 0 00000020:00000080:1.0:1790972635.894221:0:21256:0:(genops.c:885:class_export_put()) final put ffff888d07d6c000/lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1790972635.895005:0:17068:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790972635.895313:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e3d6d8800 for MGC192.168.203.139@tcp 00000020:00000080:3.0:1790972635.895325:0:38:0:(genops.c:885:class_export_put()) final put ffff888e3d6de800/5da60518-8817-4c86-8417-ee73ae6d3f86 00000020:00000080:3.0:1790972635.895328:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3d6de800/5da60518-8817-4c86-8417-ee73ae6d3f86 for MGC192.168.203.139@tcp 00000020:01000000:3.0:1790972635.895338:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.139@tcp (5da60518-8817-4c86-8417-ee73ae6d3f86) 00000020:00000080:3.0:1790972635.895640:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888d07d6c000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1790972635.896841:0:21256:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1790972635.896848:0:21256:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790972635.896852:0:21256:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790972635.896858:0:21256:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790972635.896922:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888d07d68800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790972635.897030:0:21256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790972635.897038:0:21256:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1790972635.897044:0:21256:0:(genops.c:885:class_export_put()) final put ffff888e1f7e9000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1790972635.897048:0:21256:0:(genops.c:844:class_export_destroy()) destroying export ffff888e1f7e9000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1790972635.897060:0:21256:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1790972635.897121:0:21256:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1790972635.897124:0:21256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790972635.897129:0:21256:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1790972635.897136:0:21256:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff888e3d4be000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1790972635.897141:0:21256:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff888e3ad9b380) has exports, disconnecting them 00000020:00080000:0.0:1790972635.897146:0:21256:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff888e3d4be000), last request at 1790972554 00000020:00000080:0.0:1790972635.897150:0:21256:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a113d8 00000020:00080000:0.0:1790972635.897164:0:21256:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff888e3d4be000): rc 0 00000020:00000080:0.0:1790972635.897169:0:21256:0:(genops.c:885:class_export_put()) final put ffff888e3d4be000/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1790972635.897230:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3d4be000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1790972635.932740:0:21256:0:(obd_class.h:668:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1790972635.932762:0:21256:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1790972635.932767:0:21256:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1790972635.932774:0:21256:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1790972635.932811:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff888e3d4be800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1790972635.942143:0:20105:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1790972635.942346:0:17069:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1790972635.947298:0:17068:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1790972635.947884:0:17064:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_001: service thread [ffff888e0542fc00:17064] 1 exiting: rc = 0 00000100:00100000:1.0:1790972635.948032:0:17063:0:(service.c:3206:ptlrpc_main()) ldlm_cb00_000: service thread [ffff888d06b22600:17063] 0 exiting: rc = 1 00000100:00100000:3.0:1790972635.948073:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.950972:0:17066:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_001: service thread [ffff888e0542e000:17066] 1 exiting: rc = 0 00000100:00100000:3.0:1790972635.951065:0:20106:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_003: service thread [ffff888d05d45000:20106] 3 exiting: rc = 0 00000100:00100000:3.0:1790972635.951118:0:17065:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_000: service thread [ffff888e0542ee00:17065] 0 exiting: rc = 1 00000100:00100000:1.0:1790972635.951450:0:17067:0:(service.c:3206:ptlrpc_main()) ldlm_cn00_002: service thread [ffff888e09b4aa00:17067] 2 exiting: rc = 0 00000100:00100000:3.0:1790972635.951618:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.951625:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952332:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952342:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952349:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952355:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952361:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952367:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952371:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952376:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952380:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952385:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952390:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952533:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952540:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952545:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952550:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952554:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952558:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952563:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952567:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952572:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952576:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952581:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952587:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952603:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952608:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952612:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952617:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952622:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952626:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952630:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952701:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952706:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952711:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952715:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952719:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952724:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952740:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952745:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952749:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952754:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952759:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952772:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952780:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952785:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952789:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952794:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952800:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952805:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952809:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952813:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952818:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952823:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952829:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952834:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952840:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952845:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952850:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952855:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952868:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952873:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952877:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972635.952882:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790972635.980079:0:21256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790972635.980095:0:21256:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1790972635.980102:0:21256:0:(genops.c:885:class_export_put()) final put ffff888e3d4bb800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1790972635.980107:0:21256:0:(genops.c:844:class_export_destroy()) destroying export ffff888e3d4bb800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1790972635.980117:0:21256:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1790972635.980188:0:21256:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888d07dc7800 1 00000020:00000080:3.0:1790972635.980194:0:21256:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xd61f4faa13a1137d 00000020:00000080:3.0:1790972635.980201:0:21256:0:(genops.c:885:class_export_put()) final put ffff888e26a1b800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790972635.980212:0:21256:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790972635.980223:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff888e26a1b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1790972635.980234:0:21256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790972635.980239:0:21256:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790972635.980242:0:21256:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff888d079499c0) has no exports 00000020:00000080:3.0:1790972636.102042:0:21256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790972636.102063:0:21256:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1790972636.102071:0:21256:0:(genops.c:885:class_export_put()) final put ffff888d07dc5800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1790972636.102077:0:21256:0:(genops.c:844:class_export_destroy()) destroying export ffff888d07dc5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1790972636.102089:0:21256:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1790972636.102506:0:21256:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff888d07dc2800 00000020:01000000:3.0:1790972636.102530:0:21256:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1790972636.102536:0:21256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790972636.102551:0:21256:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790972636.102556:0:21256:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff888e2d0f4d40) has no exports 00000020:00000080:3.0:1790972636.102582:0:21256:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790972636.102598:0:21256:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1790972636.102602:0:21256:0:(genops.c:885:class_export_put()) final put ffff888d07d04000/OSS_uuid 00000020:00000080:3.0:1790972636.102700:0:21256:0:(genops.c:844:class_export_destroy()) destroying export ffff888d07d04000/OSS_uuid for OSS 00000020:01000000:3.0:1790972636.102706:0:21256:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1790972636.102846:0:17076:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1790972636.102854:0:18587:0:(service.c:3206:ptlrpc_main()) ll_ost00_002: service thread [ffff888e3abf6600:18587] 2 exiting: rc = 0 00000100:00100000:1.0:1790972636.102957:0:19787:0:(service.c:3206:ptlrpc_main()) ll_ost00_004: service thread [ffff888d06ca1200:19787] 4 exiting: rc = 0 00000100:00100000:3.0:1790972636.103862:0:18585:0:(service.c:3206:ptlrpc_main()) ll_ost00_000: service thread [ffff888e0542e200:18585] 0 exiting: rc = 1 00000100:00100000:2.0:1790972636.103966:0:18586:0:(service.c:3206:ptlrpc_main()) ll_ost00_001: service thread [ffff888e0542ec00:18586] 1 exiting: rc = 0 00000100:00100000:3.0:1790972636.104228:0:19023:0:(service.c:3206:ptlrpc_main()) ll_ost00_003: service thread [ffff888d05ebcc00:19023] 3 exiting: rc = 0 00000100:00100000:0.0:1790972636.104371:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104381:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104386:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104391:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104396:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104402:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104411:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104417:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104423:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104428:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104444:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104450:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104454:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104460:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104465:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104470:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104475:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104480:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104485:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104490:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104494:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104499:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104504:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104509:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104518:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104524:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104529:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.104535:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105032:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105042:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105047:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105052:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105057:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105062:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105067:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105071:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105076:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105080:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105085:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105091:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105096:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105101:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105105:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105110:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105114:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105127:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105133:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105138:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105143:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105148:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105153:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105158:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105163:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105172:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105178:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105183:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105189:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105193:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105199:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105203:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105208:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105213:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105217:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.105222:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.106415:0:18588:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_000: service thread [ffff888e3abf6800:18588] 0 exiting: rc = 1 00000100:00100000:1.0:1790972636.106519:0:18589:0:(service.c:3206:ptlrpc_main()) ll_ost_create00_001: service thread [ffff888e3d39f400:18589] 1 exiting: rc = 0 00000100:00100000:0.0:1790972636.107459:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107467:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107473:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107478:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107483:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107488:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107494:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107499:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107504:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107509:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107514:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107520:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107525:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107530:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107535:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107568:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107573:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107578:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107583:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.107597:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108414:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108421:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108426:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108431:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108436:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108441:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108446:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108451:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108455:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108460:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108465:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108470:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108474:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108479:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108483:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108488:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108493:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108498:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108504:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108509:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108514:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108520:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108525:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108531:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108536:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.108540:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109137:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109148:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109154:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109159:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109173:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109178:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109184:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109189:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109195:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109200:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109206:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109211:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109215:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109220:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109226:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109231:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109235:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.109241:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790972636.110927:0:20219:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_003: service thread [ffff888d010c8400:20219] 3 exiting: rc = 0 00000100:00100000:1.0:1790972636.111102:0:18592:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_002: service thread [ffff888e2d12dc00:18592] 2 exiting: rc = 0 00000100:00100000:0.0:1790972636.111402:0:18591:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_001: service thread [ffff888d05dd5600:18591] 1 exiting: rc = 0 00000100:00100000:1.0:1790972636.134162:0:18590:0:(service.c:3206:ptlrpc_main()) ll_ost_io00_000: service thread [ffff888d05dd5a00:18590] 0 exiting: rc = 1 00000100:00100000:0.0:1790972636.134356:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134364:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134369:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134375:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134380:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134386:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134391:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134396:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134408:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134414:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134419:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134424:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134429:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134436:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134441:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134447:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134453:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134458:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134464:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134470:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134485:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134491:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134496:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134502:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134507:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134512:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134517:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134522:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134527:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134532:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134538:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134926:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134949:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134956:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134962:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134967:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134973:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134978:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134983:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134988:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.134994:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135002:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135008:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135014:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135020:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135027:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135033:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135038:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135043:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135049:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135054:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135059:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135064:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135070:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135075:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135087:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135093:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135098:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135110:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135117:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135122:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135134:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135147:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.135159:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972636.140125:0:18593:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff888e3f69d800:18593] 0 exiting: rc = 1 00000100:00100000:1.0:1790972636.140234:0:18594:0:(service.c:3206:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff888e3acbc400:18594] 1 exiting: rc = 0 00000100:00100000:0.0:1790972636.140336:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140343:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140348:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140353:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140358:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140363:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140369:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140374:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140379:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140384:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140389:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140394:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140399:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140404:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140410:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140415:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140420:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140425:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140431:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140436:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140441:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140446:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140451:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140455:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140460:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140464:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140483:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140488:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140494:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140500:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140505:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140510:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140515:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140520:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140525:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140530:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140535:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140893:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140902:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140907:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140913:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140918:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140923:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140928:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140932:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140937:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140954:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140960:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140966:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140971:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140976:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140980:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140985:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140990:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.140995:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.141000:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.141005:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.141011:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.141016:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.141022:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.141027:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.141041:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.141046:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.141052:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790972636.142096:0:18595:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_000: service thread [ffff888e3acbca00:18595] 0 exiting: rc = 1 00000100:00100000:1.0:1790972636.142191:0:18596:0:(service.c:3206:ptlrpc_main()) ll_ost_out00_001: service thread [ffff888e0f804800:18596] 1 exiting: rc = 0 00000100:00100000:0.0:1790972636.142347:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142356:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142362:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142369:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142374:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142380:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142386:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142392:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142398:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142403:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142411:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142416:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142434:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142442:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142448:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142453:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142460:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142465:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142471:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142477:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142484:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142490:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142497:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142503:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142523:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142531:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142536:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142542:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142550:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142557:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142562:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142567:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142584:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142831:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142838:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142844:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142866:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142874:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142881:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142887:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142894:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142902:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142908:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142915:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142921:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142927:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142933:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142938:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142959:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142966:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142972:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142978:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142984:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142990:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.142995:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.143002:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.143009:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.143014:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.143019:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.143024:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.143045:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.143052:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.143058:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790972636.143063:0:21256:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1790972636.161956:0:21256:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1790972657.061306:0:22021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1790972668.282889:0:22621:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1790972668.282894:0:22621:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1790972668.282896:0:22621:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1790972668.283004:0:22621:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff888e2d3c6000 00000020:01000004:0.0:1790972668.283024:0:22621:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1790972668.283032:0:22621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1790972668.283045:0:22621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff888d010dcd40) 00000020:00000080:0.0:1790972668.283058:0:22621:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790972668.375912:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1790972668.379456:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790972668.396486:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1790972668.397930:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1790972668.400504:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1790972668.401412:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1790972668.401833:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1790972668.402293:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1790972668.402815:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1790972668.403093:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1790972668.403885:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1790972668.404272:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1790972668.405623:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.406481:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1790972668.406826:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.407486:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1790972668.408327:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.408795:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.409463:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.409931:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1790972668.410550:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1790972668.410977:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.411280:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.411615:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.412256:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.412586:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1790972668.413045:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1790972668.413339:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.413631:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1790972668.414034:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1790972668.414341:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.414647:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.415064:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1790972668.415507:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:3.0:1790972668.416042:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1790972668.417314:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1790972668.417923:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1790972668.418135:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1790972668.418476:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1790972668.423047:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1790972668.423508:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1790972668.423804:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1790972668.423974:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1790972668.424136:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1790972668.425299:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1790972668.426347:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1790972668.426865:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1790972668.427460:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1790972668.430714:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1790972668.431073:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1790972668.431825:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1790972668.432039:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1790972668.432297:0:22621:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1790972668.434134:0:22621:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1790972668.434466:0:22621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1790972668.434475:0:22621:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:1.0:1790972668.434486:0:22621:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd61f4faa13a11823 00000020:01000004:1.0:1790972668.434493:0:22621:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1790972668.434497:0:22621:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1790972668.434513:0:22621:0:(tgt_mount.c:101:server_register_mount()) register mount ffff888e2d3c6000 from MGS 00000020:01000004:1.0:1790972668.434517:0:22621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1790972668.434528:0:22621:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff888d07948000) 00000020:00000080:1.0:1790972668.434538:0:22621:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1790972668.434604:0:22621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff888e2d3c6000 from MGS, refs=2 00080000:01000000:1.0:1790972668.434609:0:22621:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790972668.434614:0:22621:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd61f4faa13a11831 00000100:00100000:1.0:1790972668.435511:0:22621:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1790972668.435658:0:22621:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1790972668.435691:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1790972668.437594:0:22621:0:(service.c:3485:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1790972668.437605:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1790972668.440063:0:22621:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790972668.440252:0:22621:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1790972668.440258:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1790972668.442264:0:22621:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1790972668.442275:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1790972668.447375:0:22621:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1790972668.447492:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1790972668.450007:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972668.450012:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972668.450015:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972668.452649:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972668.452654:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972668.452657:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972668.453333:0:22621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1790972668.455015:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790972668.472826:0:22621:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1790972668.481026:0:22633:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1790972668.481085:0:22621:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1790972668.481146:0:22621:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790972668.481933:0:22621:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1790972668.482299:0:22621:0:(service.c:173:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790972668.482587:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1790972668.482594:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790972668.497373:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790972668.497388:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1790972668.499007:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1790972668.499017:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1790972668.504821:0:22621:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790972668.504847:0:22621:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.139@tcp' 00000020:01000004:3.0:1790972668.504849:0:22621:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790972668.504875:0:22621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.139@tcp (typ=mgc) 00000020:00000080:3.0:1790972668.504888:0:22621:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.139@tcp (ffff888d0695b380) 00000020:00000080:3.0:1790972668.504903:0:22621:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790972668.504975:0:22621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888e3fa23000@MGC192.168.203.139@tcp: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1790972668.505122:0:22621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.139@tcp-0 is initialized 00000040:01000000:3.0:1790972668.505128:0:22621:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 1 is initialized 00000100:00080000:0.0:1790972668.507363:0:22638:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1790972668.508021:0:22639:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790972668.508146:0:22621:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.139@tcp (uuid 1ec21a69-0990-44c5-a524-ae99bc1e2f2c) 00000020:00000080:3.0:1790972668.508166:0:22621:0:(genops.c:1384:class_connect()) connect: client 1ec21a69-0990-44c5-a524-ae99bc1e2f2c, cookie 0xd61f4faa13a1183f 00000100:00080000:3.0:1790972668.508176:0:22621:0:(import.c:545:import_select_connection()) MGC192.168.203.139@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790972668.508196:0:22621:0:(import.c:666:import_select_connection()) MGC192.168.203.139@tcp: import ffff888e3fa23000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1790972668.508228:0:22621:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3a7d1c00 x1877970397646208/t0(0) o250->MGC192.168.203.139@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790972668.508302:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3637:1877970397646208:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790972668.508388:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972668.508485:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397646208 00000100:00100000:2.0:1790972668.508492:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397646208 00000100:00080000:3.0:1790972668.508528:0:22621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1ec21a69-0990-44c5-a524-ae99bc1e2f2c->MGS 00000100:00100000:2.0:1790972668.510904:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790972668.510916:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3637:x1877970397646208:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1790972668.510946:0:22634:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 1ec21a69-0990-44c5-a524-ae99bc1e2f2c@0@lo t0 exp 0000000000000000 cur 606 last 0 00000020:00000080:2.0:1790972668.510972:0:22634:0:(genops.c:1384:class_connect()) connect: client 1ec21a69-0990-44c5-a524-ae99bc1e2f2c, cookie 0xd61f4faa13a11846 00000100:00080000:2.0:1790972668.511101:0:22634:0:(import.c:65:import_set_state_nolock()) ffff888e3f6b0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790972668.511272:0:3637:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.139@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790972668.511281:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.139@tcp: connect to target with instance 0 00000100:00080000:1.0:1790972668.511288:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.139@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790972668.511292:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790972668.511295:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e3fa23000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790972668.511298:0:3637:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790972668.511317:0:3637:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790972668.511322:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3637:1877970397646208:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1790972668.512103:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+5:3637:x1877970397646208:12345-0@lo:250:mount.lustre.0 Request processed in 269us (2797us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972668.512124:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000004:3.0:1790972668.512448:0:22621:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790972668.512528:0:22621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790972668.512542:0:22621:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff888d0794cd40) 00000020:00000080:1.0:1790972668.512561:0:22621:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1790972668.532128:0:22621:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790972668.532319:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790972668.532325:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790972668.535942:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790972668.535954:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790972668.537461:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790972668.537476:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790972668.538947:0:22621:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790972668.539128:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790972668.539133:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790972668.540261:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790972668.540270:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790972668.572409:0:22621:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790972668.572614:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790972668.572621:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1790972668.573953:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1790972668.573964:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1790972668.574491:0:22621:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790972668.574728:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1790972668.574734:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1790972668.575219:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790972668.575225:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790972668.575720:0:22621:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790972668.575865:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790972668.575869:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1790972668.576280:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1790972668.576286:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790972668.576874:0:22621:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790972668.577011:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790972668.577016:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790972668.578526:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790972668.578538:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790972668.599982:0:22621:0:(service.c:173:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790972668.600278:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790972668.600286:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1790972668.601827:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1790972668.601839:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790972668.602586:0:22621:0:(service.c:3485:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790972668.602595:0:22621:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790972668.603652:0:22621:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790972668.603698:0:22621:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1790972668.603704:0:22621:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790972668.603797:0:22621:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790972668.603826:0:22621:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.139@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790972668.603830:0:22621:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790972668.603832:0:22621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790972668.603833:0:22621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972668.603834:0:22621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972668.603836:0:22621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972668.603837:0:22621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972668.603838:0:22621:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790972668.603840:0:22621:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790972668.603841:0:22621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972668.603842:0:22621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790972668.603845:0:22621:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790972668.603847:0:22621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790972668.603848:0:22621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790972668.603849:0:22621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972668.603850:0:22621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972668.603851:0:22621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972668.603852:0:22621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972668.603853:0:22621:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790972668.603854:0:22621:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790972668.603855:0:22621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972668.603856:0:22621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790972668.603886:0:22621:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790972668.603903:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397646336:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790972668.603960:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972668.603993:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d62ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1790972668.604102:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397646336 00000100:00100000:0.0:1790972668.604110:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397646336 00000100:00100000:0.0:1790972668.604142:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790972668.604150:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+5:22621:x1877970397646336:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790972668.604191:0:22637:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790972668.604199:0:22637:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790972668.604202:0:22637:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790972668.604624:0:22658:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790972668.605078:0:22637:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:3.0:1790972668.606291:0:22659:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1790972668.606297:0:22659:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1790972668.606300:0:22659:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1790972668.606347:0:22659:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1790972668.606504:0:22659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1790972668.606655:0:22637:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790972668.606799:0:22637:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1790972668.607969:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+5:22621:x1877970397646336:12345-0@lo:253:mount.lustre.0 Request processed in 3813us (4002us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972668.607981:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790972668.608110:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397646336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790972668.608122:0:22621:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790972668.608125:0:22621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790972668.608127:0:22621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790972668.608129:0:22621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972668.608130:0:22621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972668.608131:0:22621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972668.608133:0:22621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972668.608134:0:22621:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790972668.608135:0:22621:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790972668.608137:0:22621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972668.608138:0:22621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790972668.608159:0:22621:0:(tgt_mount.c:101:server_register_mount()) register mount ffff888e2d3c6000 from lustre-MDT0000 10000000:01000000:2.0:1790972668.608184:0:22621:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790972668.608186:0:22621:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790972668.608190:0:22621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff888d0695b380 10000000:01000000:2.0:1790972668.608194:0:22621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790972668.608202:0:22621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff888d0695b380 from 1 10000000:01000000:2.0:1790972668.608204:0:22621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790972668.608238:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.608250:0:22621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.608261:0:22621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972668.608279:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397646464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790972668.608366:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972668.608436:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d62e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972668.608479:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397646464 00000100:00100000:3.0:1790972668.608486:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397646464 00000100:00100000:3.0:1790972668.608549:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790972668.608557:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+5:22621:x1877970397646464:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790972668.608568:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972668.608580:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3ad42200/0xd61f4faa13a1185b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11854 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.608600:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3ad42200/0xd61f4faa13a1185b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11854 expref: 6 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.608610:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3ad42200/0xd61f4faa13a1185b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11854 expref: 6 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.608618:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad42200, rc 0) 00000100:00100000:3.0:1790972668.608651:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+6:22621:x1877970397646464:12345-0@lo:101:mount.lustre.0 Request processed in 95us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972668.608656:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790972668.608740:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397646464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790972668.608765:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.608774:0:22621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972668.608822:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397646592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972668.608846:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972668.609029:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d62e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790972668.609108:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397646592 00000100:00100000:1.0:1790972668.609113:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397646592 00000100:00100000:1.0:1790972668.609133:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790972668.609139:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+6:22621:x1877970397646592:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790972668.609209:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+6:22621:x1877970397646592:12345-0@lo:501:mount.lustre.0 Request processed in 70us (361us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790972668.609216:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790972668.609286:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397646592:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790972668.609319:0:22621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790972668.609332:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609341:0:22621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972668.609349:0:22621:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff888e2d3c6000 10000000:01000000:2.0:1790972668.609353:0:22621:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790972668.609356:0:22621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff888e2d3c6000 10000000:01000000:2.0:1790972668.609358:0:22621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790972668.609361:0:22621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff888e2d3c6000 from 1 10000000:01000000:2.0:1790972668.609363:0:22621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790972668.609379:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cda00/0xd61f4faa13a11862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609386:0:22621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3d3cda00/0xd61f4faa13a11862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609413:0:22621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3d3cda00/0xd61f4faa13a11862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972668.609426:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397646720:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790972668.609449:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972668.609471:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397646720 00000100:00100000:2.0:1790972668.609474:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397646720 00000100:00100000:2.0:1790972668.609489:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790972668.609494:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+6:22621:x1877970397646720:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790972668.609500:0:22636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972668.609509:0:22636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3d3cd600/0xd61f4faa13a11869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11862 expref: -99 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609522:0:22636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3d3cd600/0xd61f4faa13a11869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11862 expref: 7 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609531:0:22636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3d3cd600/0xd61f4faa13a11869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11862 expref: 7 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609537:0:22636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3d3cd600, rc 0) 00000100:00100000:2.0:1790972668.609556:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+7:22621:x1877970397646720:12345-0@lo:101:mount.lustre.0 Request processed in 62us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972668.609561:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790972668.609578:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d62e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790972668.609587:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397646720:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790972668.609596:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3d3cda00/0xd61f4faa13a11862 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11869 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609608:0:22621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3d3cda00/0xd61f4faa13a11862 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11869 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972668.609618:0:22621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790972668.609622:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cda00/0xd61f4faa13a11862 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11869 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609629:0:22621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3d3cda00/0xd61f4faa13a11862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11869 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972668.609634:0:22621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790972668.609637:0:22621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790972668.609641:0:22621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff888e2d3c6000 10000000:01000000:2.0:1790972668.609643:0:22621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790972668.609645:0:22621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790972668.609647:0:22621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790972668.609658:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd800/0xd61f4faa13a11870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609709:0:22621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd800/0xd61f4faa13a11870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609716:0:22621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd800/0xd61f4faa13a11870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972668.609743:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397646848:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790972668.609764:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972668.609779:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397646848 00000100:00100000:2.0:1790972668.609788:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397646848 00000100:00100000:2.0:1790972668.609803:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790972668.609808:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+7:22621:x1877970397646848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790972668.609814:0:22636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972668.609821:0:22636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3d3cc600/0xd61f4faa13a11877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11870 expref: -99 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609832:0:22636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3d3cc600/0xd61f4faa13a11877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11870 expref: 8 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609840:0:22636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3d3cc600/0xd61f4faa13a11877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11870 expref: 8 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609846:0:22636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3d3cc600, rc 0) 00000100:00100000:2.0:1790972668.609865:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+8:22621:x1877970397646848:12345-0@lo:101:mount.lustre.0 Request processed in 57us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972668.609870:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790972668.609887:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d62e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790972668.609896:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397646848:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790972668.609906:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd800/0xd61f4faa13a11870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11877 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.609913:0:22621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd800/0xd61f4faa13a11870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11877 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972668.609945:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397646976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972668.609963:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972668.609977:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397646976 00000100:00100000:2.0:1790972668.609984:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397646976 00000100:00100000:2.0:1790972668.609998:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790972668.610003:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+8:22621:x1877970397646976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972668.610085:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+9:22621:x1877970397646976:12345-0@lo:501:mount.lustre.0 Request processed in 82us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972668.610091:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790972668.610108:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e07c46480 going to sleep for 11 seconds 00000100:00100000:2.0:1790972668.610116:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397646976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972668.610137:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397647104:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790972668.610169:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972668.610183:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397647104 00000100:00100000:2.0:1790972668.610186:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397647104 00000100:00100000:2.0:1790972668.610199:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790972668.610203:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+9:22621:x1877970397647104:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790972668.610323:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e07c46480 going to sleep for 11 seconds 00000100:00100000:2.0:1790972668.610790:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+9:22621:x1877970397647104:12345-0@lo:503:mount.lustre.0 Request processed in 584us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972668.610797:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790972668.610838:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397647104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790972668.611432:0:22660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05489f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22660:1877970397647232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790972668.611473:0:22660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972668.611535:0:22660:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e04ed7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1790972668.611567:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397647232 00000100:00100000:2.0:1790972668.611571:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397647232 00000100:00100000:2.0:1790972668.611624:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790972668.611632:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+9:22660:x1877970397647232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790972668.612181:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+9:22660:x1877970397647232:12345-0@lo:502:llog_process_th.0 Request processed in 548us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972668.612197:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790972668.612276:0:22660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05489f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22660:1877970397647232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790972668.612311:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972668.612321:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.612323:0:22660:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790972668.612328:0:22660:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790972668.612331:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790972668.612348:0:22660:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff888d0794b380) 00000020:00000080:1.0:1790972668.612363:0:22660:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790972668.612367:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790972668.612457:0:22660:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790972668.612463:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd61f4faa13a11885 00000020:00000080:1.0:1790972668.612652:0:22660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790972668.612656:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972668.612688:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.612690:0:22660:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790972668.612693:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972668.612697:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.612698:0:22660:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790972668.612701:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790972668.612708:0:22660:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff888d079499c0) 00000020:00000080:1.0:1790972668.612717:0:22660:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790972668.612721:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790972668.612723:0:22660:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790972668.612725:0:22660:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790972668.612730:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790972668.612767:0:22660:0:(tgt_mount.c:153:server_get_mount()) get mount ffff888e2d3c6000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790972668.612781:0:22660:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff888d078f4d40) 00000020:00000080:1.0:1790972668.612788:0:22660:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790972668.612856:0:22660:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790972668.612862:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd61f4faa13a1189a 00000020:00000080:1.0:1790972668.612943:0:22660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790972668.612947:0:22660:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790972668.612950:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd61f4faa13a118a1 00080000:01000000:1.0:1790972668.612954:0:22660:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790972668.612957:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd61f4faa13a118a8 00010000:00010000:1.0:1790972668.662076:0:22660:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1790972668.662690:0:22660:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:1.0:1790972668.662959:0:22660:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1790972668.663616:0:22660:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff888d078f19c0) 00000020:00000080:1.0:1790972668.663643:0:22660:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1790972668.668071:0:22660:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790972668.668089:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd61f4faa13a118b6 00000020:00000080:1.0:1790972668.668728:0:22660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1790972668.679918:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd61f4faa13a118bd 00000020:00000080:1.0:1790972668.680837:0:22660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790972668.680850:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972668.680857:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.680859:0:22660:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790972668.680863:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790972668.680865:0:22660:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1790972668.680867:0:22660:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790972668.680869:0:22660:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790972668.680870:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790972668.680873:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.680874:0:22660:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790972668.680877:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972668.680881:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.680882:0:22660:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790972668.680886:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790972668.680925:0:22660:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790972668.680940:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972668.680943:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.680945:0:22660:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1790972668.680947:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972668.680950:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.680951:0:22660:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1790972668.680954:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790972668.680960:0:22660:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:00000080:1.0:1790972668.680987:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790972668.681001:0:22660:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff888d078f3380) 00000020:00000080:1.0:1790972668.681016:0:22660:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1790972668.681021:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790972668.681075:0:22660:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1790972668.681080:0:22660:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790972668.681095:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd61f4faa13a118cb 00010000:00080000:1.0:1790972668.681126:0:22660:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888e3af95000@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:1.0:1790972668.682732:0:22660:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1790972668.687444:0:22660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790972668.687460:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1790972668.687501:0:22660:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790972668.687520:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd61f4faa13a118d2 00000100:00080000:1.0:1790972668.687530:0:22660:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790972668.687541:0:22660:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff888e3af95000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1790972668.687579:0:22660:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e05489f80 x1877970397647360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790972668.687609:0:22660:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1790972668.687713:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972668.687717:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.687719:0:22660:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1790972668.687722:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790972668.687725:0:22660:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1790972668.687727:0:22660:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790972668.687728:0:22660:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790972668.687730:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790972668.687732:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.687734:0:22660:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790972668.687736:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790972668.687740:0:22660:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1790972668.687744:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.687746:0:22660:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1790972668.687749:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790972668.687753:0:22660:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:1.0:1790972668.687775:0:22660:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1790972668.687778:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790972668.687789:0:22660:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff888d078f0000) 00000020:00000080:1.0:1790972668.687808:0:22660:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1790972668.687813:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790972668.687879:0:22660:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1790972668.687885:0:22660:0:(osd_handler.c:8931:osd_obd_connect()) connect #6 00000020:00000080:1.0:1790972668.687891:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd61f4faa13a118e0 00010000:00080000:1.0:1790972668.687917:0:22660:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888e394b7000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:1.0:1790972668.688116:0:22660:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:3.0:1790972668.692219:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397647360:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790972668.692292:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972668.692379:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397647360 00000100:00100000:3.0:1790972668.692388:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397647360 00000100:00100000:3.0:1790972668.692428:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790972668.692435:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1877970397647360:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1790972668.692452:0:22647:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1790972668.694951:0:22660:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790972668.696828:0:22660:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1790972668.699106:0:22660:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790972668.699954:0:22660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1790972668.708882:0:22660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1790972668.712328:0:22666:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1790972668.712337:0:22666:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1790972668.715306:0:22660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790972668.715321:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790972668.715364:0:22660:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790972668.715381:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd61f4faa13a118e7 00000100:00080000:2.0:1790972668.715403:0:22660:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790972668.715414:0:22660:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff888e394b7000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1790972668.715448:0:22660:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3d522a00 x1877970397647488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790972668.715508:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397647488:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790972668.715573:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877970397647488 offset 0 length 520: 4 00000100:00080000:2.0:1790972668.715615:0:22660:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790972668.715846:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790972668.715850:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972668.715852:0:22660:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790972668.715855:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1790972668.715857:0:22660:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1790972668.715859:0:22660:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790972668.715860:0:22660:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1790972668.715862:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1790972668.715865:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972668.715866:0:22660:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1790972668.715869:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790972668.715872:0:22660:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1790972668.715876:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972668.715877:0:22660:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790972668.715880:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790972668.715883:0:22660:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:2.0:1790972668.715901:0:22660:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790972668.715903:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790972668.715913:0:22660:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff888e3ad9cd40) 00000020:00000080:2.0:1790972668.715925:0:22660:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1790972668.715935:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790972668.716006:0:22660:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1790972668.716013:0:22660:0:(osd_handler.c:8931:osd_obd_connect()) connect #7 00000020:00000080:2.0:1790972668.716020:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd61f4faa13a118f5 00010000:00080000:2.0:1790972668.716046:0:22660:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888d07d6a000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:2.0:1790972668.716618:0:22660:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1790972668.717017:0:22660:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790972668.717031:0:22660:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790972668.719521:0:22660:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1790972668.719884:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e3af95000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790972668.719894:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790972668.719899:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397647360:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790972668.719918:0:22660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1790972668.720063:0:22660:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:3.0:1790972668.720088:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1877970397647360:12345-0@lo:38:llog_process_th.0 Request processed in 27650us (27794us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790972668.720100:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1790972668.720858:0:22668:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790972668.720863:0:22668:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790972668.721511:0:22660:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790972668.721525:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790972668.721574:0:22660:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790972668.721593:0:22660:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd61f4faa13a118fc 00000100:00080000:1.0:1790972668.721607:0:22660:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790972668.721618:0:22660:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff888d07d6a000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1790972668.721692:0:22660:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e05489f80 x1877970397647616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790972668.721715:0:22660:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1790972668.721743:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397647616:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1790972668.721767:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972668.721771:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.721777:0:22660:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790972668.721780:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972668.721784:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.721785:0:22660:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790972668.721787:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790972668.721789:0:22660:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790972668.721791:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972668.721793:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.721794:0:22660:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790972668.721796:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972668.721798:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.721799:0:22660:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790972668.721802:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000400:00000100:0.0:1790972668.721802:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877970397647616 offset 0 length 520: 4 00000100:00100000:1.0:1790972668.721829:0:22660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05488700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22660:1877970397647744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790972668.721874:0:22660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972668.721896:0:22660:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d32a900 going to sleep for 11 seconds 00000100:00100000:0.0:1790972668.721909:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397647744 00000100:00100000:0.0:1790972668.721915:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397647744 00000100:00100000:0.0:1790972668.722037:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790972668.722046:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+9:22660:x1877970397647744:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790972668.722174:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+9:22660:x1877970397647744:12345-0@lo:502:llog_process_th.0 Request processed in 128us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972668.722182:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790972668.722256:0:22660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05488700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22660:1877970397647744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790972668.722281:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972668.722284:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.722286:0:22660:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790972668.722289:0:22660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1790972668.722563:0:22621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1790972668.722584:0:22621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790972668.722603:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd800/0xd61f4faa13a11870 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11877 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.722615:0:22621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd800/0xd61f4faa13a11870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11877 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972668.722623:0:22621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff888e2d3c6000 from 1 10000000:01000000:3.0:1790972668.722626:0:22621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790972668.722652:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.722689:0:22621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.722698:0:22621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972668.722714:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397647872:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790972668.722753:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972668.723027:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1790972668.723074:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397647872 00000100:00100000:2.0:1790972668.723080:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397647872 00000100:00100000:2.0:1790972668.723106:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790972668.723113:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+9:22621:x1877970397647872:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790972668.723123:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972668.723149:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a1190a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11903 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.723170:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a1190a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11903 expref: 10 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.723180:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a1190a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11903 expref: 10 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.723188:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3d3cc400, rc 0) 00000100:00100000:2.0:1790972668.723268:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+10:22621:x1877970397647872:12345-0@lo:101:mount.lustre.0 Request processed in 155us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972668.723274:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790972668.723476:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397647872:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790972668.723490:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1190a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.723499:0:22621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a1190a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972668.724641:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397648000:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1790972668.724997:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972668.725062:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1790972668.725109:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397648000 00000100:00100000:2.0:1790972668.725122:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397648000 00000100:00100000:2.0:1790972668.725238:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790972668.725247:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+10:22621:x1877970397648000:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1790972668.725267:0:22634:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790972668.725273:0:22634:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790972668.725547:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+10:22621:x1877970397648000:12345-0@lo:256:mount.lustre.0 Request processed in 300us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972668.725555:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790972668.725615:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397648000:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1790972668.726626:0:22621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790972668.726906:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1190a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.726919:0:22621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1190a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972668.726927:0:22621:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff888e2d3c6000 from 1 10000000:01000000:3.0:1790972668.726930:0:22621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790972668.726966:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.726973:0:22621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.726996:0:22621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972668.727017:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397648128:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790972668.727067:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972668.727142:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7300 going to sleep for 11 seconds 00000100:00100000:0.0:1790972668.727254:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397648128 00000100:00100000:0.0:1790972668.727261:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397648128 00000100:00100000:0.0:1790972668.727414:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790972668.727425:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+10:22621:x1877970397648128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790972668.727438:0:22637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790972668.727453:0:22637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11918 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11911 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.727486:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11911 expref: 11 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.727496:0:22637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11911 expref: 11 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.727504:0:22637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e15085e00, rc 0) 00000100:00100000:0.0:1790972668.727552:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+11:22621:x1877970397648128:12345-0@lo:101:mount.lustre.0 Request processed in 129us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972668.727559:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790972668.727629:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397648128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790972668.727644:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11918 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.727652:0:22621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11918 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972668.727749:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397648256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790972668.727774:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972668.728021:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7300 going to sleep for 11 seconds 00000100:00100000:2.0:1790972668.728053:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397648256 00000100:00100000:2.0:1790972668.728059:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397648256 00000100:00100000:2.0:1790972668.728081:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790972668.728088:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+11:22621:x1877970397648256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972668.728384:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+11:22621:x1877970397648256:12345-0@lo:501:mount.lustre.0 Request processed in 296us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972668.728401:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790972668.728636:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397648256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972668.728942:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397648384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790972668.728988:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972668.729050:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09af6540 going to sleep for 11 seconds 00000100:00100000:0.0:1790972668.729087:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397648384 00000100:00100000:0.0:1790972668.729091:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397648384 00000100:00100000:0.0:1790972668.729216:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790972668.729225:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+11:22621:x1877970397648384:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790972668.729438:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+11:22621:x1877970397648384:12345-0@lo:503:mount.lustre.0 Request processed in 214us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972668.729446:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790972668.729535:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397648384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790972668.730011:0:22670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05488700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22670:1877970397648512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790972668.730050:0:22670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972668.730079:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d32ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1790972668.730122:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397648512 00000100:00100000:2.0:1790972668.730127:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397648512 00000100:00100000:2.0:1790972668.730229:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790972668.730237:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+11:22670:x1877970397648512:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790972668.730688:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+11:22670:x1877970397648512:12345-0@lo:502:llog_process_th.0 Request processed in 451us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972668.730696:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790972668.730911:0:22670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05488700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22670:1877970397648512:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790972668.730939:0:22670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972668.730948:0:22670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.730950:0:22670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790972668.730957:0:22670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff888e2d3c6000 00000020:00000080:1.0:1790972668.730959:0:22670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790972668.730973:0:22670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972668.730976:0:22670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.730977:0:22670:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790972668.730980:0:22670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972668.730982:0:22670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.730983:0:22670:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790972668.730987:0:22670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff888e2d3c6000 00000020:00000080:1.0:1790972668.730989:0:22670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790972668.731042:0:22670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972668.731045:0:22670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.731047:0:22670:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790972668.731049:0:22670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972668.731051:0:22670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.731053:0:22670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790972668.731056:0:22670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff888e2d3c6000 00000020:00000080:1.0:1790972668.731058:0:22670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790972668.731091:0:22670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972668.731093:0:22670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.731094:0:22670:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790972668.731097:0:22670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972668.731099:0:22670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.731100:0:22670:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790972668.731103:0:22670:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff888e2d3c6000 00000020:00000080:1.0:1790972668.731106:0:22670:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790972668.731266:0:22670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05488700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22670:1877970397648640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790972668.731403:0:22670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972668.731432:0:22670:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d32ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1790972668.731492:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397648640 00000100:00100000:3.0:1790972668.731497:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397648640 00000100:00100000:3.0:1790972668.731522:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790972668.731529:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+11:22670:x1877970397648640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790972668.731636:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+11:22670:x1877970397648640:12345-0@lo:502:llog_process_th.0 Request processed in 106us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972668.731651:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790972668.732826:0:22670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05488700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22670:1877970397648640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790972668.732864:0:22670:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972668.732870:0:22670:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972668.732872:0:22670:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790972668.732877:0:22670:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1790972668.733027:0:22621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790972668.733053:0:22621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790972668.733075:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11918 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.733086:0:22621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11918 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972668.733203:0:22621:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790972668.733207:0:22621:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff888e2d3c6000 10000000:01000000:3.0:1790972668.733210:0:22621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff888e2d3c6000 10000000:01000000:3.0:1790972668.733214:0:22621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790972668.733220:0:22621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff888e2d3c6000 from 1 10000000:01000000:3.0:1790972668.733223:0:22621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790972668.733252:0:22621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42000/0xd61f4faa13a1191f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.733259:0:22621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3ad42000/0xd61f4faa13a1191f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.733267:0:22621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3ad42000/0xd61f4faa13a1191f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972668.733286:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397648768:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790972668.733412:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972668.733446:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7180 going to sleep for 11 seconds 00000100:00100000:3.0:1790972668.733465:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397648768 00000100:00100000:3.0:1790972668.733469:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397648768 00000100:00100000:3.0:1790972668.733507:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790972668.733514:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+11:22621:x1877970397648768:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790972668.733526:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972668.733538:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3ad43e00/0xd61f4faa13a11926 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a1191f expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.733559:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3ad43e00/0xd61f4faa13a11926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a1191f expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.733569:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3ad43e00/0xd61f4faa13a11926 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a1191f expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.733578:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad43e00, rc 0) 00000100:00100000:3.0:1790972668.733613:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22621:x1877970397648768:12345-0@lo:101:mount.lustre.0 Request processed in 99us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972668.733619:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790972668.733657:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397648768:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790972668.733695:0:22621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3ad42000/0xd61f4faa13a1191f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11926 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.734388:0:22621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3ad42000/0xd61f4faa13a1191f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11926 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972668.734458:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397648896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790972668.734495:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972668.735817:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7180 going to sleep for 11 seconds 00000100:00100000:0.0:1790972668.745434:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397648896 00000100:00100000:0.0:1790972668.745454:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397648896 00000100:00100000:0.0:1790972668.745510:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790972668.745520:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22621:x1877970397648896:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790972668.746255:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22621:x1877970397648896:12345-0@lo:501:mount.lustre.0 Request processed in 735us (11757us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972668.746265:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790972668.753370:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397648896:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790972668.753449:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397649024:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790972668.753527:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972668.753564:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7180 going to sleep for 11 seconds 00000100:00100000:2.0:1790972668.763290:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397649024 00000100:00100000:2.0:1790972668.763442:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397649024 00000100:00100000:2.0:1790972668.763513:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790972668.763525:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22621:x1877970397649024:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790972668.763901:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397649024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790972668.764116:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22621:x1877970397649024:12345-0@lo:503:mount.lustre.0 Request processed in 593us (10588us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972668.764125:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790972668.773023:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22675:1877970397649152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790972668.773124:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972668.774014:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e2dc203c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790972668.774078:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397649152 00000100:00100000:1.0:1790972668.774087:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397649152 00000100:00100000:1.0:1790972668.774383:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790972668.774403:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22675:x1877970397649152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790972668.774541:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22675:x1877970397649152:12345-0@lo:502:llog_process_th.0 Request processed in 148us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972668.774548:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790972668.774846:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa01500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22675:1877970397649152:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1790972668.774914:0:22675:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1790972668.774930:0:22675:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff888d010db380) 00000020:00000080:0.0:1790972668.774950:0:22675:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1790972668.775035:0:22675:0:(tgt_mount.c:153:server_get_mount()) get mount ffff888e2d3c6000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790972668.775040:0:22675:0:(tgt_mount.c:187:server_put_mount()) put mount ffff888e2d3c6000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1790972668.775042:0:22675:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888e2d3c6000 4 00010000:00080000:0.0:1790972668.775070:0:22675:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888e26a18800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1790972668.780656:0:22675:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1790972668.783000:0:22675:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1790972668.783044:0:22675:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1790972668.783056:0:22675:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd61f4faa13a11934 00000100:00080000:0.0:1790972668.783067:0:22675:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790972668.783078:0:22675:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff888e26a18800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972668.783114:0:22675:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa01500 x1877970397649280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790972668.783154:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877970397649280:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790972668.783216:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972668.783290:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397649280 00000100:00100000:0.0:1790972668.783296:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397649280 00000100:00100000:0.0:1790972668.783334:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790972668.783341:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877970397649280:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1790972668.783403:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877970397649280:12345-0@lo:38:llog_process_th.0 Request processed in 61us (187us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790972668.783411:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790972668.783450:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790972668.783458:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e26a18800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790972668.783472:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1790972668.783475:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877970397649280:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790972668.783505:0:22675:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790972668.784526:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05488700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22675:1877970397649408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790972668.784597:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972668.784624:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d32a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790972668.784907:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397649408 00000100:00100000:2.0:1790972668.784915:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397649408 00000100:00100000:2.0:1790972668.785112:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790972668.785122:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22675:x1877970397649408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790972668.785465:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22675:x1877970397649408:12345-0@lo:502:llog_process_th.0 Request processed in 345us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972668.785474:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790972668.790263:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05488700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22675:1877970397649408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790972668.790350:0:22675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05488700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22675:1877970397649536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790972668.790433:0:22675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972668.790467:0:22675:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d32a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790972668.790564:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397649536 00000100:00100000:0.0:1790972668.790571:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397649536 00000100:00100000:0.0:1790972668.790622:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790972668.790630:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22675:x1877970397649536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790972668.790909:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22675:x1877970397649536:12345-0@lo:502:llog_process_th.0 Request processed in 279us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972668.790917:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790972668.790999:0:22675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05488700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22675:1877970397649536:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1790972668.791023:0:22675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1790972668.791542:0:22621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790972668.791568:0:22621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790972668.791589:0:22621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42000/0xd61f4faa13a1191f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11926 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972668.791600:0:22621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3ad42000/0xd61f4faa13a1191f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11926 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790972668.791647:0:22621:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790972668.791649:0:22621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790972668.791650:0:22621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972668.791651:0:22621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972668.791652:0:22621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972668.791653:0:22621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972668.791655:0:22621:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790972668.791656:0:22621:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790972668.791658:0:22621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972668.791732:0:22621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790972668.791736:0:22621:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1790972668.791743:0:22621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790972668.791744:0:22621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790972668.791745:0:22621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972668.791746:0:22621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972668.791747:0:22621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972668.791748:0:22621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972668.791749:0:22621:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790972668.791750:0:22621:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790972668.791751:0:22621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972668.791752:0:22621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790972668.791773:0:22621:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790972668.791789:0:22621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397649664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790972668.791834:0:22621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972668.791861:0:22621:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5a000 going to sleep for 11 seconds 00000100:00100000:3.0:1790972668.792095:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397649664 00000100:00100000:3.0:1790972668.792102:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397649664 00000100:00100000:3.0:1790972668.792154:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790972668.792163:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22621:x1877970397649664:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790972668.792188:0:22637:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790972668.792201:0:22637:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790972668.808785:0:22637:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790972668.808805:0:22637:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1790972668.809012:0:22658:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790972668.809017:0:22658:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790972668.809039:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.809058:0:22658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a1190a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11903 expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.809067:0:22658:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.809105:0:22658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a1190a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11903 expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.809120:0:22658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a1190a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11903 expref: 12 pid: 22634 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972668.809158:0:22658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa01500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397649792:0@lo:104: 00000100:00100000:0.0:1790972668.809230:0:22658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972668.809274:0:22658:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e2dc20f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790972668.809616:0:22625:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397649792 00000100:00100000:1.0:1790972668.809627:0:22625:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397649792 00000100:00100000:3.0:1790972668.809830:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22621:x1877970397649664:12345-0@lo:253:mount.lustre.0 Request processed in 17667us (17993us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972668.809840:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790972668.809939:0:22621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22621:1877970397649664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790972668.809951:0:22621:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790972668.809954:0:22621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790972668.809956:0:22621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790972668.809957:0:22621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972668.809958:0:22621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972668.809959:0:22621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972668.809961:0:22621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972668.809962:0:22621:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790972668.809963:0:22621:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790972668.809965:0:22621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972668.809966:0:22621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790972668.809982:0:22621:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790972668.811484:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790972668.811503:0:22625:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+3:22658:x1877970397649792:12345-0@lo:104: 00010000:00010000:1.0:1790972668.811520:0:22625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a1190a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972668.811602:0:22625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790972668.811608:0:22625:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+3:22658:x1877970397649792:12345-0@lo:104: Request processed in 114us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972668.811630:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790972668.813375:0:22658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa01500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397649792:0@lo:104: 00010000:00010000:0.0:1790972668.813417:0:22658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.813656:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972668.813699:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a1190a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.813708:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad43000 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:3.0:1790972668.813712:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a1190a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.813722:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a1190a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790972668.813729:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a1190a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972668.813734:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790972668.813807:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a1190a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.813814:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790972668.813837:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a1190a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.813844:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3ad43000/0xd61f4faa13a11903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a1190a expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972668.813863:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972668.813865:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972668.813866:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972668.813904:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397649920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790972668.813966:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972668.814742:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397649920 00000100:00100000:0.0:1790972668.814750:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397649920 00010000:00010000:0.0:1790972668.814777:0:22627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a1190a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11903 expref: 12 pid: 22634 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972668.814811:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790972668.814820:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:3641:x1877970397649920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972668.814833:0:22627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972668.814838:0:22627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a1190a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11903 expref: 12 pid: 22634 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.814850:0:22627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a1190a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11903 expref: 12 pid: 22634 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.814866:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a1190a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11903 expref: 12 pid: 22634 timeout: 706 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.814880:0:22627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.814889:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790972668.814914:0:22627:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005897832s 00010000:00010000:0.0:1790972668.814918:0:22627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.814926:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.814932:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.814939:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.814944:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e15085c00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972668.814948:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.814956:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.814970:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.814980:0:22627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790972668.815028:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+11:3641:x1877970397649920:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972668.815035:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790972668.815059:0:22658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.815076:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972668.815082:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e15085c00/0xd61f4faa13a1193b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972668.816896:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397649920:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1790972668.833515:0:22621:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1790972668.833880:0:22621:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1790972668.834027:0:22681:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:3.0:1790972668.834031:0:22681:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:0.0:1790972668.837096:0:22682:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1790972668.837996:0:22682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1790972668.839509:0:22621:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1790972668.843508:0:22682:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790972668.843573:0:22682:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:2.0:1790972668.844115:0:22683:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff888e3d521180 x1877970397650048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972668.844141:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00000040:01000000:1.0:1790972668.845009:0:22621:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1790972668.845051:0:22621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1790972668.845907:0:22621:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1790972668.845918:0:22621:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1790972668.845969:0:22621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790972668.847552:0:22621:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1790972668.850993:0:22621:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1790972668.851286:0:22621:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1790972668.852442:0:22621:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1790972668.853497:0:22621:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:2.0:1790972668.857956:0:22621:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1790972668.861119:0:22621:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790972668.861170:0:22621:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9f73c1c2f988 00100000:10000000:2.0:1790972668.861198:0:22621:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790972668.864733:0:22621:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790972668.864753:0:22621:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790972668.864773:0:22621:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790972668.864791:0:22621:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1790972668.869846:0:22621:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790972668.870071:0:22621:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790972669.493211:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790972669.817621:0:22676:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790972669.817631:0:22676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790972669.818782:0:22676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790972669.818792:0:22676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1790972669.884528:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 10000000:01000000:0.0:1790972670.004844:0:22639:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790972670.004856:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff888e2d3c6000 from 11 10000000:01000000:0.0:1790972670.004862:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790972670.004922:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972670.004935:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972670.004946:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972670.004974:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397650176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790972670.005052:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972670.005096:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09af6480 going to sleep for 11 seconds 00000100:00100000:1.0:1790972670.005245:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397650176 00000100:00100000:1.0:1790972670.005254:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397650176 00000100:00100000:1.0:1790972670.005300:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790972670.005309:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+11:22639:x1877970397650176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790972670.005323:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972670.005338:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11942 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972670.005372:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11942 expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972670.005392:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11942 expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972670.005402:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e09feae00, rc 0) 00000100:00100000:1.0:1790972670.005453:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22639:x1877970397650176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972670.005460:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790972670.006362:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa01500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397650176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790972670.006395:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11949 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972670.006406:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11949 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972670.006471:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397650304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790972670.006521:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972670.006553:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06a43600 going to sleep for 11 seconds 00000100:00100000:1.0:1790972670.007005:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397650304 00000100:00100000:1.0:1790972670.007012:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397650304 00000100:00100000:1.0:1790972670.007060:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790972670.007068:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22639:x1877970397650304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790972670.007087:0:22637:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790972670.007103:0:22637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790972670.007107:0:22637:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1790972670.007208:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:22639:x1877970397650304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972670.007216:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790972670.007308:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397650304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790972670.007351:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790972670.007369:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11949 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972670.007379:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11949 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972670.517948:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790972670.836851:0:22676:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790972670.836859:0:22676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790972670.837060:0:22676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1790972670.837107:0:22676:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790972670.837260:0:22676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1790972670.900736:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00010000:00010000:0.0:1790972671.541433:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972671.924797:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00010000:00010000:3.0:1790972672.572246:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972672.957818:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00010000:00010000:0.0:1790972673.590015:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972673.981286:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00000100:00080000:2.0:1790972674.298084:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790972674.298091:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790972674.298094:0:38:0:(import.c:65:import_set_state_nolock()) ffff888e3af95000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790972674.298101:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:2.0:1790972674.298107:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790972674.298117:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff888e3af95000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1790972674.298139:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3d521f80 x1877970397650560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790972674.298154:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972674.298157:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790972674.298160:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972674.298162:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790972674.298165:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790972674.298168:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790972674.298169:0:38:0:(import.c:65:import_set_state_nolock()) ffff888e26a18800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790972674.298174:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff888e26a18800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1790972674.298183:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3d520380 x1877970397650688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790972674.298228:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790972674.298240:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3639:1877970397650432:0@lo:400:kworker.0 00000100:00100000:2.0:1790972674.298306:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972674.298388:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397650560:0@lo:38:kworker.0 00000100:00100000:2.0:1790972674.298430:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972674.298448:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877970397650688:0@lo:38:kworker.0 00000100:00100000:2.0:1790972674.298490:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972674.298522:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397650432 00000100:00100000:2.0:1790972674.298529:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397650432 00000100:00100000:2.0:1790972674.298571:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790972674.298580:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:3639:x1877970397650432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972674.298628:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:3639:x1877970397650432:12345-0@lo:400:kworker.0 Request processed in 49us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972674.298635:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790972674.298700:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397650560 00000100:00100000:2.0:1790972674.298704:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397650560 00000100:00100000:2.0:1790972674.298723:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790972674.298728:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877970397650560:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790972674.298744:0:22648:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790972674.298777:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d521880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877970397650560:12345-0@lo:38:kworker.0 Request processed in 48us (346us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790972674.298784:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790972674.298821:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e3af95000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790972674.298825:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790972674.298828:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397650560:0@lo:38:kworker.0 00000100:00100000:2.0:1790972674.298855:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3639:1877970397650432:0@lo:400:kworker.0 00000100:00100000:0.0:1790972674.301707:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397650688 00000100:00100000:0.0:1790972674.301725:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397650688 00000100:00100000:0.0:1790972674.301775:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790972674.301785:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1877970397650688:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1790972674.301817:0:22644:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 612 last 0 00000020:00000080:0.0:1790972674.301857:0:22644:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd61f4faa13a11950 00000004:00100000:0.0:1790972674.301873:0:22644:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790972674.302027:0:22644:0:(import.c:65:import_set_state_nolock()) ffff888d07d6d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790972674.302113:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d520a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1877970397650688:12345-0@lo:38:kworker.0 Request processed in 328us (3622us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972674.302121:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790972674.302297:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff888e3d520380 x1877970397650688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790972684 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790972674.302316:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790972674.302339:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790972674.302344:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790972674.302346:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e26a18800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790972674.302363:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3637:1877970397650688:0@lo:38:kworker.0 00000001:02000400:2.0:1790972674.372172:0:22926:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790972674.612829:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972674.999412:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00000020:00000004:1.0:1790972675.491324:0:22978:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1790972675.491901:0:22978:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790972675.636874:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972676.022471:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00000020:00000004:0.0:1790972676.462611:0:23028:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790972676.462977:0:23028:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790972676.665042:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972677.044834:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00010000:00010000:0.0:1790972677.685164:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972678.079873:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00000100:00100000:0.0:1790972678.388784:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972668/real 1790972668] req@ffff888e05489f80 x1877970397647616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972678 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972678.388815:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e05489f80 x1877970397647616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972678 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972678.388827:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972668/real 1790972668] req@ffff888e3d522a00 x1877970397647488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972678 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972678.388840:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e3d522a00 x1877970397647488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972678 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790972678.388859:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d07d6a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790972678.388906:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790972678.388910:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397647616:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1790972678.388917:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e394b7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790972678.388922:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790972678.388925:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397647488:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790972678.395991:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790972678.395998:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790972678.396002:0:37:0:(import.c:65:import_set_state_nolock()) ffff888e3af95000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790972678.396010:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 612 00000100:00080000:2.0:1790972678.396016:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790972678.396026:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff888e3af95000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1790972678.396049:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3d520000 x1877970397650944/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790972678.396083:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972678.396086:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790972678.396088:0:37:0:(import.c:65:import_set_state_nolock()) ffff888e394b7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790972678.396092:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:2.0:1790972678.396094:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790972678.396099:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff888e394b7000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1790972678.396110:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3d521f80 x1877970397651072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790972678.396119:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972678.396135:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790972678.396137:0:37:0:(import.c:65:import_set_state_nolock()) ffff888d07d6a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790972678.396140:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 606 00000100:00080000:2.0:1790972678.396143:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790972678.396148:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff888d07d6a000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1790972678.396161:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3d522a00 x1877970397651200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790972678.396274:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397650944:0@lo:38:kworker.0 00000100:00100000:1.0:1790972678.396348:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972678.396421:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397651072:0@lo:8:kworker.0 00000400:00000100:1.0:1790972678.396440:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877970397651072 offset 0 length 520: 4 00000100:00100000:1.0:1790972678.396459:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397651200:0@lo:8:kworker.0 00000400:00000100:1.0:1790972678.396478:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877970397651200 offset 0 length 520: 4 00000100:00100000:2.0:1790972678.396720:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397650944 00000100:00100000:2.0:1790972678.396729:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397650944 00000100:00100000:2.0:1790972678.396761:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790972678.396768:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877970397650944:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790972678.396787:0:22648:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790972678.396825:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790972678.396830:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05488700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877970397650944:12345-0@lo:38:kworker.0 Request processed in 60us (481us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790972678.396837:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790972678.396845:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3638:1877970397650816:0@lo:400:kworker.0 00000100:00100000:3.0:1790972678.396882:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972678.396932:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877970397651328:0@lo:400:kworker.0 00000100:00100000:3.0:1790972678.396971:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790972678.397018:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e3af95000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790972678.397023:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790972678.397026:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397650944:0@lo:38:kworker.0 00000100:00100000:2.0:1790972678.397696:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397650816 00000100:00100000:2.0:1790972678.397702:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397650816 00000100:00100000:2.0:1790972678.397735:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790972678.397753:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:3638:x1877970397650816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972678.397809:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:3638:x1877970397650816:12345-0@lo:400:kworker.0 Request processed in 57us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972678.397815:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790972678.397864:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397651328 00000100:00100000:2.0:1790972678.397868:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397651328 00000100:00100000:2.0:1790972678.397889:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790972678.397896:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877970397651328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972678.397969:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877970397651328:12345-0@lo:400:kworker.0 Request processed in 72us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972678.397975:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790972678.397981:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff888e3d523800 x1877970397651328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972678.397993:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d523800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877970397651328:0@lo:400:kworker.0 00000100:00100000:2.0:1790972678.397997:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3638:1877970397650816:0@lo:400:kworker.0 00010000:00010000:0.0:1790972678.709087:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790972679.094841:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00010000:00010000:2.0:1790972679.734838:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790972680.059786:0:22676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790972680.116870:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00010000:00010000:3.0:1790972680.757917:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972681.147589:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00010000:00010000:0.0:1790972681.790227:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790972682.174729:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00010000:00010000:0.0:1790972682.809166:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790972683.189182:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00000100:00080000:0.0:1790972683.510417:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1790972683.510423:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1790972683.510427:0:38:0:(import.c:65:import_set_state_nolock()) ffff888e3af95000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972683.510434:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 616 00000100:00080000:0.0:1790972683.510439:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1790972683.510451:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff888e3af95000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972683.510473:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa02300 x1877970397651584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790972683.510489:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972683.510493:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790972683.510495:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972683.510498:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790972683.510528:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790972683.510546:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877970397651712:0@lo:400:kworker.0 00000100:00100000:0.0:1790972683.510615:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972683.510927:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790972683.510937:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397651456:0@lo:400:kworker.0 00000100:00100000:2.0:1790972683.510976:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972683.511023:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397651712 00000100:00100000:2.0:1790972683.511031:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397651712 00000100:00100000:2.0:1790972683.511073:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790972683.511081:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877970397651712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972683.511129:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877970397651712:12345-0@lo:400:kworker.0 Request processed in 49us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972683.511136:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790972683.511177:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff888e3fa00000 x1877970397651712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972699 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972683.511190:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877970397651712:0@lo:400:kworker.0 00000100:00100000:1.0:1790972683.511302:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397651584:0@lo:38:kworker.0 00000100:00100000:1.0:1790972683.511334:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972683.511499:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397651456 00000100:00100000:0.0:1790972683.511505:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397651456 00000100:00100000:0.0:1790972683.511546:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790972683.511554:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:3640:x1877970397651456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972683.511602:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:3640:x1877970397651456:12345-0@lo:400:kworker.0 Request processed in 50us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972683.511609:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1790972683.512090:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397651584 00000100:00100000:2.0:1790972683.512096:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397651584 00000100:00100000:2.0:1790972683.512125:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790972683.512130:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877970397651584:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1790972683.512145:0:22648:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790972683.512181:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3637:x1877970397651584:12345-0@lo:38:kworker.0 Request processed in 50us (846us total) trans 0 rc -19/-19 00000100:00080000:1.0:1790972683.512766:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e3af95000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790972683.512774:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790972683.512777:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397651584:0@lo:38:kworker.0 00000100:00100000:2.0:1790972683.512932:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790972683.513059:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397651456:0@lo:400:kworker.0 00010000:00010000:2.0:1790972683.830938:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790972684.010871:0:23373:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790972684.010874:0:23373:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1790972684.010876:0:23373:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1790972684.010985:0:23373:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff888e02880000 00000020:01000004:3.0:1790972684.011000:0:23373:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1790972684.011082:0:23373:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790972684.011103:0:23373:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff888d069599c0) 00000020:00000080:3.0:1790972684.011118:0:23373:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1790972684.080421:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1790972684.082323:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1790972684.084703:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1790972684.085246:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1790972684.085682:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1790972684.085997:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1790972684.086312:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1790972684.086508:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1790972684.086905:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1790972684.087543:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1790972684.087872:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1790972684.088194:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1790972684.089218:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1790972684.090056:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1790972684.091272:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1790972684.091697:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.092345:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.092793:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.092999:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.093478:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.093842:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.094115:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.094956:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.095958:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.096325:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.096560:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.096826:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.096999:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.097322:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.097484:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.097694:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.098082:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.098369:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.098584:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.098892:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.099168:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.099484:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.099802:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.100056:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.100378:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.100572:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.100870:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.101329:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.101611:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1790972684.101938:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1790972684.102319:0:23373:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00080000:01000000:2.0:1790972684.104115:0:23373:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790972684.104359:0:23373:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1790972684.104371:0:23373:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790972684.104382:0:23373:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd61f4faa13a1195e 00000020:01000004:2.0:1790972684.104389:0:23373:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1790972684.104408:0:23373:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790972684.104411:0:23373:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790972684.104417:0:23373:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1790972684.104443:0:23373:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1790972684.104448:0:23373:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1790972684.108562:0:23373:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790972684.108597:0:23373:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.139@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1790972684.108601:0:23373:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790972684.108603:0:23373:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790972684.108605:0:23373:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972684.108606:0:23373:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972684.108607:0:23373:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972684.108608:0:23373:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972684.108610:0:23373:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790972684.108611:0:23373:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972684.108612:0:23373:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790972684.108615:0:23373:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1790972684.108618:0:23373:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790972684.108619:0:23373:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790972684.108623:0:23373:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972684.108624:0:23373:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972684.108625:0:23373:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972684.108626:0:23373:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972684.108627:0:23373:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790972684.108628:0:23373:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972684.108629:0:23373:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790972684.108652:0:23373:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1790972684.108837:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397651840:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790972684.108905:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972684.108935:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d580f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790972684.108999:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397651840 00000100:00100000:0.0:1790972684.109006:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397651840 00000100:00100000:0.0:1790972684.109060:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790972684.109067:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:23373:x1877970397651840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790972684.109095:0:22636:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790972684.109098:0:22636:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1790972684.109106:0:22636:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1790972684.109613:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:23373:x1877970397651840:12345-0@lo:253:mount.lustre.0 Request processed in 544us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972684.109622:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790972684.109811:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397651840:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790972684.109823:0:23373:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1790972684.109826:0:23373:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790972684.109827:0:23373:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1790972684.109829:0:23373:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972684.109830:0:23373:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972684.109831:0:23373:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972684.109832:0:23373:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972684.109833:0:23373:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790972684.109835:0:23373:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972684.109836:0:23373:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790972684.109855:0:23373:0:(tgt_mount.c:101:server_register_mount()) register mount ffff888e02880000 from lustre-MDT0001 10000000:01000000:2.0:1790972684.109882:0:23373:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1790972684.109884:0:23373:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1790972684.109892:0:23373:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff888d0695b380 local copy 00010000:00010000:2.0:1790972684.109902:0:23373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972684.109989:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397651968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972684.110033:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972684.110066:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d580f00 going to sleep for 11 seconds 00000100:00100000:1.0:1790972684.110269:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397651968 00000100:00100000:1.0:1790972684.110275:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397651968 00000100:00100000:1.0:1790972684.110322:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790972684.110330:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:23373:x1877970397651968:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790972684.110445:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:23373:x1877970397651968:12345-0@lo:501:mount.lustre.0 Request processed in 115us (411us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790972684.110453:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790972684.110594:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397651968:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790972684.110608:0:23373:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790972684.110627:0:23373:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790972684.110635:0:23373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.110644:0:23373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972684.110814:0:23373:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff888e02880000 10000000:01000000:0.0:1790972684.110833:0:23373:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790972684.110838:0:23373:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff888d0695b380 10000000:01000000:0.0:1790972684.110841:0:23373:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1790972684.110844:0:23373:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff888d0695b380 from 1 10000000:01000000:0.0:1790972684.110847:0:23373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1790972684.110875:0:23373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e15084600/0xd61f4faa13a11965 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.110884:0:23373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e15084600/0xd61f4faa13a11965 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.110892:0:23373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e15084600/0xd61f4faa13a11965 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972684.110908:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652096:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790972684.110940:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.111003:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e0374c9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790972684.111101:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397652096 00000100:00100000:2.0:1790972684.111106:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397652096 00000100:00100000:2.0:1790972684.111314:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790972684.111322:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+12:23373:x1877970397652096:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790972684.111334:0:22636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972684.111349:0:22636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3d3cde00/0xd61f4faa13a1196c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11965 expref: -99 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972684.111371:0:22636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3d3cde00/0xd61f4faa13a1196c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11965 expref: 13 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972684.111381:0:22636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3d3cde00/0xd61f4faa13a1196c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11965 expref: 13 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972684.111390:0:22636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3d3cde00, rc 0) 00000100:00100000:2.0:1790972684.111431:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+13:23373:x1877970397652096:12345-0@lo:101:mount.lustre.0 Request processed in 110us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972684.111438:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790972684.111495:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652096:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790972684.111508:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e15084600/0xd61f4faa13a11965 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1196c expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.111516:0:23373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e15084600/0xd61f4faa13a11965 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a1196c expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972684.111531:0:23373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1790972684.111551:0:23373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e15084600/0xd61f4faa13a11965 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1196c expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.111558:0:23373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e15084600/0xd61f4faa13a11965 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1196c expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972684.111577:0:23373:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff888e02880000 10000000:01000000:0.0:1790972684.111581:0:23373:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1790972684.111584:0:23373:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff888e02880000 from 1 10000000:01000000:0.0:1790972684.111586:0:23373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1790972684.111601:0:23373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e15085c00/0xd61f4faa13a11973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.111606:0:23373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e15085c00/0xd61f4faa13a11973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.111613:0:23373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e15085c00/0xd61f4faa13a11973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972684.111625:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790972684.111652:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.111939:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e0374c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790972684.112015:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397652224 00000100:00100000:1.0:1790972684.112021:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397652224 00000100:00100000:1.0:1790972684.112045:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790972684.112052:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+13:23373:x1877970397652224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790972684.112060:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972684.112069:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e09fea600/0xd61f4faa13a1197a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11973 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.112085:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e09fea600/0xd61f4faa13a1197a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11973 expref: 14 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.112092:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e09fea600/0xd61f4faa13a1197a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11973 expref: 14 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.112110:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e09fea600, rc 0) 00000100:00100000:1.0:1790972684.112158:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+14:23373:x1877970397652224:12345-0@lo:101:mount.lustre.0 Request processed in 107us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972684.112165:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790972684.112326:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790972684.112337:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e15085c00/0xd61f4faa13a11973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1197a expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.112344:0:23373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e15085c00/0xd61f4faa13a11973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a1197a expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972684.112355:0:23373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1790972684.112371:0:23373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e15085c00/0xd61f4faa13a11973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1197a expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.112379:0:23373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e15085c00/0xd61f4faa13a11973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1197a expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972684.112392:0:23373:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1790972684.112396:0:23373:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790972684.112401:0:23373:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff888e02880000 10000000:01000000:0.0:1790972684.112403:0:23373:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1790972684.112406:0:23373:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1790972684.112409:0:23373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1790972684.112426:0:23373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e15085200/0xd61f4faa13a11981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.112433:0:23373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e15085200/0xd61f4faa13a11981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.112440:0:23373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e15085200/0xd61f4faa13a11981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972684.112453:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790972684.112480:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.112492:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e0374c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790972684.112607:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397652352 00000100:00100000:1.0:1790972684.112612:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397652352 00000100:00100000:1.0:1790972684.112631:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790972684.112637:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+14:23373:x1877970397652352:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790972684.112644:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972684.112652:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e09febc00/0xd61f4faa13a11988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11981 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.112699:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e09febc00/0xd61f4faa13a11988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11981 expref: 15 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.112708:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e09febc00/0xd61f4faa13a11988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11981 expref: 15 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.112714:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e09febc00, rc 0) 00000100:00100000:1.0:1790972684.112882:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+15:23373:x1877970397652352:12345-0@lo:101:mount.lustre.0 Request processed in 244us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972684.112887:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1790972684.112970:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790972684.112982:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e15085200/0xd61f4faa13a11981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11988 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.112990:0:23373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e15085200/0xd61f4faa13a11981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11988 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790972684.114623:0:23373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1790972684.115316:0:23373:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790972684.124403:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1790972684.125323:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1790972684.125349:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1790972684.125366:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1790972684.125382:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1790972684.125401:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1790972684.125558:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1790972684.125584:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1790972684.125600:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1790972684.125617:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1790972684.125644:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1790972684.125690:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1790972684.125709:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1790972684.125736:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1790972684.125752:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1790972684.125767:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1790972684.125782:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1790972684.126227:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1790972684.126256:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1790972684.126273:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1790972684.126300:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1790972684.126315:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1790972684.126328:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1790972684.126343:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1790972684.126357:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1790972684.126378:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1790972684.126391:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1790972684.126405:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1790972684.126435:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1790972684.126453:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1790972684.126469:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1790972684.126484:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1790972684.126499:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1790972684.126514:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1790972684.126548:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1790972684.126564:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1790972684.126579:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1790972684.126596:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1790972684.126612:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1790972684.126628:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1790972684.126643:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1790972684.126657:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1790972684.126701:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1790972684.126716:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1790972684.126747:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1790972684.126754:0:23373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1790972684.127233:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790972684.127304:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.127347:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3aaf1240 going to sleep for 11 seconds 00000100:00100000:1.0:1790972684.127619:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397652480 00000100:00100000:1.0:1790972684.127627:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397652480 00000100:00100000:1.0:1790972684.127731:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790972684.127741:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+15:23373:x1877970397652480:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790972684.127901:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+15:23373:x1877970397652480:12345-0@lo:501:mount.lustre.0 Request processed in 161us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972684.127919:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790972684.128470:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790972684.128513:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790972684.128566:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.128599:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3aaf1240 going to sleep for 11 seconds 00000100:00100000:1.0:1790972684.128969:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397652608 00000100:00100000:1.0:1790972684.128975:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397652608 00000100:00100000:1.0:1790972684.129025:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1790972684.129033:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+15:23373:x1877970397652608:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790972684.130380:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+15:23373:x1877970397652608:12345-0@lo:503:mount.lustre.0 Request processed in 1341us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972684.130394:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1790972684.130401:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652608:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790972684.132377:0:23373:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790972684.132473:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652736:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790972684.132559:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972684.133264:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3adefcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790972684.138315:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397652736 00000100:00100000:2.0:1790972684.138330:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397652736 00000100:00100000:3.0:1790972684.138602:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790972684.138614:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+15:23373:x1877970397652736:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790972684.139519:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+15:23373:x1877970397652736:12345-0@lo:502:mount.lustre.0 Request processed in 905us (6957us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972684.139530:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790972684.139648:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790972684.139925:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1790972684.139960:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:1.0:1790972684.139974:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:1.0:1790972684.139987:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:1.0:1790972684.140000:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:1.0:1790972684.140012:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:1.0:1790972684.140025:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:1.0:1790972684.140037:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:1.0:1790972684.140048:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:1.0:1790972684.140060:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:1.0:1790972684.140088:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:1.0:1790972684.140109:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:1.0:1790972684.140123:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:1.0:1790972684.140135:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:1.0:1790972684.140149:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:1.0:1790972684.140173:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:1.0:1790972684.140184:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:1.0:1790972684.140207:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:1.0:1790972684.140221:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:1.0:1790972684.140233:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:1.0:1790972684.140247:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:1.0:1790972684.140261:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:1.0:1790972684.140271:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:1.0:1790972684.140297:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:1.0:1790972684.140314:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:1.0:1790972684.140328:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:1.0:1790972684.140341:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:1.0:1790972684.140356:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:1.0:1790972684.140370:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:1.0:1790972684.140383:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:1.0:1790972684.140395:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:1.0:1790972684.140407:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:1.0:1790972684.140420:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:1.0:1790972684.140431:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:1.0:1790972684.140441:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:1.0:1790972684.140454:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:1.0:1790972684.140468:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:1.0:1790972684.140481:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:1.0:1790972684.140494:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:1.0:1790972684.140506:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:1.0:1790972684.140517:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:1.0:1790972684.140528:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:1.0:1790972684.140541:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:1.0:1790972684.140555:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:1.0:1790972684.140592:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790972684.140653:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.146823:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3adefcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790972684.147095:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397652864 00000100:00100000:2.0:1790972684.147106:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397652864 00000100:00100000:2.0:1790972684.147156:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790972684.147164:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+15:23373:x1877970397652864:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972684.147341:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+15:23373:x1877970397652864:12345-0@lo:502:mount.lustre.0 Request processed in 177us (6688us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972684.147349:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790972684.147920:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397652864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790972684.148081:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:0.0:1790972684.148095:0:23373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1790972684.149636:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972684.150095:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972684.150101:0:23377:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1790972684.150110:0:23377:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1790972684.150114:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790972684.150131:0:23377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff888e3d040000) 00000020:00000080:1.0:1790972684.150151:0:23377:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1790972684.150159:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790972684.150234:0:23377:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:1.0:1790972684.150240:0:23377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd61f4faa13a11996 00000020:00000080:1.0:1790972684.151133:0:23377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1790972684.151144:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972684.151151:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972684.151153:0:23377:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1790972684.151157:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972684.151162:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972684.151163:0:23377:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1790972684.151167:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790972684.151178:0:23377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff888e3d0419c0) 00000020:00000080:1.0:1790972684.151194:0:23377:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1790972684.151198:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790972684.151200:0:23377:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1790972684.151203:0:23377:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1790972684.151209:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790972684.151273:0:23377:0:(tgt_mount.c:153:server_get_mount()) get mount ffff888e02880000 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1790972684.151295:0:23377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff888e3d044d40) 00000020:00000080:1.0:1790972684.151304:0:23377:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1790972684.151380:0:23377:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790972684.151385:0:23377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd61f4faa13a119ab 00000020:00000080:1.0:1790972684.151567:0:23377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1790972684.151574:0:23377:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790972684.151579:0:23377:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd61f4faa13a119b2 00080000:01000000:1.0:1790972684.151585:0:23377:0:(osd_handler.c:8931:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790972684.151588:0:23377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd61f4faa13a119b9 00000100:00100000:3.0:1790972684.216526:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00010000:00010000:2.0:1790972684.229107:0:23377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1790972684.230436:0:23377:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1790972684.230934:0:23377:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790972684.233490:0:23377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1790972684.233507:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790972684.233515:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972684.233517:0:23377:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1790972684.233521:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790972684.233529:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972684.233530:0:23377:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1790972684.233534:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790972684.233540:0:23377:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:00000080:2.0:1790972684.233569:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790972684.233584:0:23377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff888e3ad98000) 00000020:00000080:2.0:1790972684.233609:0:23377:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1790972684.233614:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1790972684.233716:0:23377:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1790972684.233724:0:23377:0:(osd_handler.c:8931:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790972684.233733:0:23377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd61f4faa13a119c7 00010000:00080000:2.0:1790972684.233763:0:23377:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888e04990800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1790972684.242458:0:23377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1790972684.246976:0:23377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1790972684.246992:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1790972684.247036:0:23377:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790972684.247058:0:23377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd61f4faa13a119ce 00000100:00080000:0.0:1790972684.247081:0:23377:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790972684.247093:0:23377:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff888e04990800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972684.247127:0:23377:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa00e00 x1877970397652992/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790972684.247159:0:23377:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1790972684.247288:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790972684.247292:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790972684.247294:0:23377:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1790972684.247297:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790972684.247300:0:23377:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1790972684.247302:0:23377:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790972684.247303:0:23377:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790972684.247305:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790972684.247307:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790972684.247308:0:23377:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790972684.247310:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790972684.247315:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790972684.247316:0:23377:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1790972684.247320:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790972684.247353:0:23377:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790972684.247366:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790972684.247369:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790972684.247371:0:23377:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1790972684.247373:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790972684.247375:0:23377:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1790972684.247376:0:23377:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790972684.247378:0:23377:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790972684.247379:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790972684.247381:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790972684.247382:0:23377:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790972684.247384:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790972684.247387:0:23377:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1790972684.247390:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790972684.247396:0:23377:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790972684.247400:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790972684.247404:0:23377:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:0.0:1790972684.247425:0:23377:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1790972684.247427:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790972684.247440:0:23377:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff888d010d99c0) 00000020:00000080:0.0:1790972684.247451:0:23377:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1790972684.247455:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790972684.247511:0:23377:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1790972684.247518:0:23377:0:(osd_handler.c:8931:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790972684.247522:0:23377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd61f4faa13a119dc 00010000:00080000:0.0:1790972684.247548:0:23377:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888e20346800@lustre-OST0000-osc-MDT0001: add connection 192.168.203.139@tcp at head 00010000:00010000:0.0:1790972684.247805:0:23377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:1.0:1790972684.249322:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397652992:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790972684.249420:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.249549:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397652992 00000100:00100000:0.0:1790972684.249557:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397652992 00000100:00100000:0.0:1790972684.249597:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790972684.249605:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1877970397652992:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790972684.249629:0:22647:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:0.0:1790972684.249686:0:22647:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd61f4faa13a119e3 00000004:00100000:0.0:1790972684.249700:0:22647:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1790972684.249705:0:22647:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:0.0:1790972684.251461:0:23377:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790972684.252096:0:23377:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1790972684.252496:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790972684.252502:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1790972684.252505:0:38:0:(import.c:65:import_set_state_nolock()) ffff888e3af95000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790972684.252513:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 621 00000100:00080000:3.0:1790972684.252517:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1790972684.252529:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff888e3af95000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1790972684.252564:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3a7d3800 x1877970397653120/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790972684.252594:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972684.252598:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790972684.252601:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972684.252604:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790972684.252721:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877970397653248:0@lo:400:kworker.0 00000100:00100000:2.0:1790972684.252790:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972684.252853:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397653248 00000100:00100000:3.0:1790972684.252862:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397653248 00000100:00100000:3.0:1790972684.252918:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790972684.252927:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877970397653248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972684.252980:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d523100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877970397653248:12345-0@lo:400:kworker.0 Request processed in 54us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972684.252987:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790972684.253149:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff888e3a7d1c00 x1877970397653248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972700 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972684.253162:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877970397653248:0@lo:400:kworker.0 00000100:00100000:1.0:1790972684.253301:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397653120:0@lo:38:kworker.0 00000100:00100000:1.0:1790972684.253334:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972684.253942:0:22648:0:(service.c:3485:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1790972684.253951:0:22648:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1790972684.256945:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397653120 00000100:00100000:2.0:1790972684.256958:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397653120 00000100:00100000:3.0:1790972684.257190:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790972684.257199:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1877970397653120:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1790972684.257324:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3637:x1877970397653120:12345-0@lo:38:kworker.0 Request processed in 125us (3988us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790972684.257331:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790972684.257460:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790972684.257469:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e3af95000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790972684.257474:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790972684.257478:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397653120:0@lo:38:kworker.0 00000040:00080000:0.0:1790972684.261129:0:23377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1790972684.265118:0:22647:0:(import.c:65:import_set_state_nolock()) ffff888e3ac8a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790972684.265235:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05488380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1877970397652992:12345-0@lo:38:llog_process_th.0 Request processed in 15626us (15812us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972684.265252:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790972684.265551:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790972684.265561:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1790972684.265570:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1790972684.265575:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790972684.265577:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e04990800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790972684.265596:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397652992:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790972684.265759:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397653376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790972684.265799:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972684.265870:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397653376 00000100:00100000:3.0:1790972684.265877:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397653376 00000100:00100000:3.0:1790972684.265913:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790972684.265921:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1877970397653376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790972684.265949:0:22648:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790972684.265989:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d522300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3640:x1877970397653376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972684.265995:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1790972684.266013:0:23377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1790972684.266166:0:23377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:2.0:1790972684.266409:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397653376:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1790972684.273631:0:23383:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790972684.273638:0:23383:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1790972684.274252:0:23377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790972684.274264:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790972684.274316:0:23377:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1790972684.274337:0:23377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd61f4faa13a119ea 00000100:00080000:1.0:1790972684.274347:0:23377:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790972684.274357:0:23377:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff888e20346800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1790972684.274392:0:23377:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e0548aa00 x1877970397653504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790972684.274466:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397653504:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790972684.274525:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877970397653504 offset 0 length 520: 4 00000100:00080000:1.0:1790972684.274582:0:23377:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1790972684.274655:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972684.274685:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972684.274688:0:23377:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1790972684.274692:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790972684.274695:0:23377:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1790972684.274697:0:23377:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790972684.274698:0:23377:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790972684.274700:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790972684.274702:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972684.274704:0:23377:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790972684.274706:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1790972684.274718:0:23377:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1790972684.274721:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972684.274723:0:23377:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1790972684.274726:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1790972684.274730:0:23377:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.139@tcp to nid 0x20000c0a8cb8b (192.168.203.139@tcp) 00000020:01000000:1.0:1790972684.274751:0:23377:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1790972684.274753:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790972684.274764:0:23377:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff888e3d043380) 00000020:00000080:1.0:1790972684.274777:0:23377:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1790972684.274782:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1790972684.274853:0:23377:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1790972684.274859:0:23377:0:(osd_handler.c:8931:osd_obd_connect()) connect #5 00000020:00000080:1.0:1790972684.274864:0:23377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd61f4faa13a119f8 00010000:00080000:1.0:1790972684.274890:0:23377:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888d05dfd000@lustre-OST0001-osc-MDT0001: add connection 192.168.203.139@tcp at head 00010000:00010000:1.0:1790972684.275311:0:23377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1790972684.275385:0:23377:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1790972684.275400:0:23377:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1790972684.276057:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972684.276064:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790972684.276067:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972684.276070:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:1.0:1790972684.277395:0:23377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790972684.277606:0:23377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1790972684.278210:0:23377:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1790972684.278762:0:23385:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790972684.278768:0:23385:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1790972684.279618:0:23377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1790972684.279631:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1790972684.279881:0:23377:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1790972684.279903:0:23377:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd61f4faa13a119ff 00000100:00080000:1.0:1790972684.279914:0:23377:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790972684.279925:0:23377:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff888d05dfd000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1790972684.280054:0:23377:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e05489f80 x1877970397653632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790972684.280121:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397653632:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1790972684.280177:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877970397653632 offset 0 length 520: 4 00000100:00080000:1.0:1790972684.280305:0:23377:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1790972684.280375:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972684.280386:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972684.280388:0:23377:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1790972684.280392:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972684.280395:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972684.280396:0:23377:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790972684.280399:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790972684.280401:0:23377:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790972684.280404:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972684.280406:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972684.280407:0:23377:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790972684.280409:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972684.280411:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972684.280412:0:23377:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790972684.280415:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790972684.280440:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972684.280444:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972684.280445:0:23377:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790972684.280448:0:23377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000100:00080000:3.0:1790972684.280585:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972684.280590:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790972684.280598:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972684.280601:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1790972684.280711:0:23373:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1790972684.280743:0:23373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1790972684.280762:0:23373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e15085200/0xd61f4faa13a11981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11988 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.280778:0:23373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e15085200/0xd61f4faa13a11981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11988 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972684.280787:0:23373:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff888e02880000 from 1 10000000:01000000:0.0:1790972684.280789:0:23373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790972684.280829:0:23373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.280838:0:23373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.280850:0:23373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972684.280868:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397653760:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790972684.280915:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.280942:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3aaf1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790972684.281234:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397653760 00000100:00100000:3.0:1790972684.281240:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397653760 00000100:00100000:3.0:1790972684.281295:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790972684.281304:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+15:23373:x1877970397653760:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790972684.281317:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972684.281329:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3ad43000/0xd61f4faa13a11a0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11a06 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.281353:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3ad43000/0xd61f4faa13a11a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11a06 expref: 16 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.281364:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3ad43000/0xd61f4faa13a11a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a06 expref: 16 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.281372:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad43000, rc 0) 00000100:00100000:3.0:1790972684.281422:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+16:23373:x1877970397653760:12345-0@lo:101:mount.lustre.0 Request processed in 119us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972684.281429:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790972684.281516:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397653760:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790972684.281531:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a0d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.281539:0:23373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11a0d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972684.282324:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05488000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397653888:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1790972684.282373:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972684.282403:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d08907240 going to sleep for 11 seconds 00000100:00100000:1.0:1790972684.282423:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397653888 00000100:00100000:1.0:1790972684.282429:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397653888 00000100:00100000:1.0:1790972684.282458:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790972684.282464:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+16:23373:x1877970397653888:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1790972684.282517:0:22637:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790972684.282532:0:22637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790972684.282535:0:22637:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1790972684.282626:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+16:23373:x1877970397653888:12345-0@lo:256:mount.lustre.0 Request processed in 161us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972684.282634:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790972684.282700:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05488000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397653888:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1790972684.283716:0:23373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790972684.283816:0:23373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a0d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.283828:0:23373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a0d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790972684.283835:0:23373:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff888e02880000 from 1 10000000:01000000:1.0:1790972684.283837:0:23373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790972684.283866:0:23373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.283874:0:23373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.283883:0:23373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972684.283900:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05488000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654016:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790972684.283943:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972684.284115:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d08907240 going to sleep for 11 seconds 00000100:00100000:1.0:1790972684.284144:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397654016 00000100:00100000:1.0:1790972684.284150:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397654016 00000100:00100000:1.0:1790972684.284196:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790972684.284204:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+16:23373:x1877970397654016:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790972684.284216:0:22636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972684.284226:0:22636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11a1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11a14 expref: -99 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.284247:0:22636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11a14 expref: 17 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.284256:0:22636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a14 expref: 17 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.284264:0:22636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e09fea200, rc 0) 00000100:00100000:1.0:1790972684.284310:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:23373:x1877970397654016:12345-0@lo:101:mount.lustre.0 Request processed in 107us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972684.284317:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790972684.284361:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05488000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654016:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790972684.284375:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a1b expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.284382:0:23373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11a1b expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790972684.292462:0:23373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1790972684.292776:0:23373:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790972684.293019:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1790972684.293042:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1790972684.293058:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1790972684.293069:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1790972684.293080:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1790972684.293090:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1790972684.293101:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1790972684.293111:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1790972684.293122:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1790972684.293140:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1790972684.293160:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1790972684.293175:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1790972684.293179:0:23373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1790972684.293265:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972684.293341:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972684.293383:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972684.294238:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397654144 00000100:00100000:3.0:1790972684.294249:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397654144 00000100:00100000:3.0:1790972684.294312:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790972684.294321:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:23373:x1877970397654144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790972684.294459:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:23373:x1877970397654144:12345-0@lo:501:mount.lustre.0 Request processed in 140us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972684.294467:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790972684.295475:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654144:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972684.295522:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654272:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790972684.295573:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972684.295608:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790972684.295645:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397654272 00000100:00100000:1.0:1790972684.295652:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397654272 00000100:00100000:1.0:1790972684.295719:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790972684.295727:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:23373:x1877970397654272:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790972684.295844:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:23373:x1877970397654272:12345-0@lo:503:mount.lustre.0 Request processed in 117us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972684.295851:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790972684.296608:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654272:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790972684.297243:0:23373:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790972684.297334:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972684.297392:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972684.297435:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b593c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790972684.297730:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397654400 00000100:00100000:1.0:1790972684.297737:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397654400 00000100:00100000:1.0:1790972684.297779:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790972684.297787:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:23373:x1877970397654400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790972684.297904:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:23373:x1877970397654400:12345-0@lo:502:mount.lustre.0 Request processed in 117us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972684.297911:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790972684.299743:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654400:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972684.300317:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1790972684.300355:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1790972684.300370:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1790972684.300384:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1790972684.300397:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1790972684.300408:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1790972684.300420:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1790972684.300432:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1790972684.300443:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1790972684.300455:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1790972684.300482:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1790972684.300520:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972684.300596:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972684.301127:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b593c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972684.304473:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397654528 00000100:00100000:3.0:1790972684.304488:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397654528 00000100:00100000:3.0:1790972684.305084:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790972684.305101:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:23373:x1877970397654528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790972684.305358:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:23373:x1877970397654528:12345-0@lo:502:mount.lustre.0 Request processed in 262us (4761us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972684.305501:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972684.305723:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1790972684.305739:0:23373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1790972684.307186:0:23387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790972684.307197:0:23387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972684.307199:0:23387:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790972684.307207:0:23387:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff888e02880000 00000020:00000080:2.0:1790972684.307209:0:23387:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790972684.307216:0:23387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790972684.307219:0:23387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972684.307220:0:23387:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790972684.307223:0:23387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790972684.307225:0:23387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972684.307227:0:23387:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790972684.307230:0:23387:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff888e02880000 00000020:00000080:2.0:1790972684.307244:0:23387:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790972684.307320:0:23387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790972684.307324:0:23387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972684.307325:0:23387:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790972684.307327:0:23387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790972684.307330:0:23387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972684.307332:0:23387:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790972684.307335:0:23387:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff888e02880000 00000020:00000080:2.0:1790972684.307337:0:23387:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790972684.307376:0:23387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790972684.307379:0:23387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972684.307491:0:23387:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790972684.307496:0:23387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790972684.307506:0:23387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972684.307508:0:23387:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790972684.307512:0:23387:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff888e02880000 00000020:00000080:2.0:1790972684.307514:0:23387:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790972684.307541:0:23387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790972684.307545:0:23387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972684.307546:0:23387:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790972684.307549:0:23387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:2.0:1790972684.307694:0:23373:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1790972684.307721:0:23373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790972684.307738:0:23373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a1b expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972684.307750:0:23373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a1b expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972684.307796:0:23373:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790972684.307799:0:23373:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff888e02880000 10000000:01000000:2.0:1790972684.307802:0:23373:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff888e02880000 10000000:01000000:2.0:1790972684.307806:0:23373:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790972684.307812:0:23373:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff888e02880000 from 1 10000000:01000000:2.0:1790972684.307815:0:23373:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790972684.307851:0:23373:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cca00/0xd61f4faa13a11a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972684.307860:0:23373:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3d3cca00/0xd61f4faa13a11a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972684.307870:0:23373:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3d3cca00/0xd61f4faa13a11a22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972684.308062:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654656:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790972684.308133:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972684.308176:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b59600 going to sleep for 11 seconds 00000100:00100000:0.0:1790972684.308472:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397654656 00000100:00100000:0.0:1790972684.308481:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397654656 00000100:00100000:0.0:1790972684.308532:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790972684.308544:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:23373:x1877970397654656:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790972684.308562:0:22637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790972684.308578:0:22637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e15084a00/0xd61f4faa13a11a29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11a22 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.308604:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e15084a00/0xd61f4faa13a11a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11a22 expref: 19 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.308630:0:22637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e15084a00/0xd61f4faa13a11a29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a22 expref: 19 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.308639:0:22637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e15084a00, rc 0) 00000100:00100000:0.0:1790972684.308720:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:23373:x1877970397654656:12345-0@lo:101:mount.lustre.0 Request processed in 177us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972684.308727:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790972684.308746:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654656:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790972684.308763:0:23373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3d3cca00/0xd61f4faa13a11a22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a29 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972684.308773:0:23373:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3d3cca00/0xd61f4faa13a11a22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11a29 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972684.314161:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000040:00080000:0.0:1790972684.318447:0:23373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1790972684.320830:0:23373:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790972684.321127:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1790972684.321158:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1790972684.321172:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1790972684.321185:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1790972684.321231:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1790972684.321249:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1790972684.321264:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1790972684.321289:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1790972684.321308:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1790972684.321324:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1790972684.321337:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1790972684.321352:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1790972684.321368:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1790972684.321391:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1790972684.321409:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1790972684.321425:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1790972684.321440:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1790972684.321455:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1790972684.321470:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1790972684.321485:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1790972684.321518:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1790972684.321545:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1790972684.321561:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1790972684.321576:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1790972684.321592:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1790972684.321607:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1790972684.321625:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1790972684.321642:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1790972684.321684:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1790972684.321704:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1790972684.321719:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1790972684.321731:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1790972684.321745:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1790972684.321758:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1790972684.321770:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1790972684.321786:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1790972684.321817:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1790972684.321837:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1790972684.321855:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1790972684.321868:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1790972684.321884:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1790972684.321901:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1790972684.321917:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1790972684.321933:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1790972684.321950:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1790972684.321966:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1790972684.321984:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1790972684.322004:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1790972684.322151:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1790972684.322171:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1790972684.322191:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1790972684.322197:0:23373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1790972684.322309:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790972684.322383:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.322424:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790972684.322451:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397654784 00000100:00100000:0.0:1790972684.322457:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397654784 00000100:00100000:0.0:1790972684.322498:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790972684.322506:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:23373:x1877970397654784:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790972684.322619:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:23373:x1877970397654784:12345-0@lo:501:mount.lustre.0 Request processed in 114us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972684.322627:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790972684.322695:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654784:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790972684.322723:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654912:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790972684.322759:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.322775:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972684.324811:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397654912 00000100:00100000:3.0:1790972684.324823:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397654912 00000100:00100000:3.0:1790972684.324871:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790972684.324879:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:23373:x1877970397654912:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790972684.325021:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:23373:x1877970397654912:12345-0@lo:503:mount.lustre.0 Request processed in 142us (2261us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972684.325028:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790972684.329561:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397654912:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790972684.330062:0:23373:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790972684.330156:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397655040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790972684.333563:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.333606:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397655040 00000100:00100000:0.0:1790972684.333615:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397655040 00000100:00100000:0.0:1790972684.333677:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790972684.333687:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:23373:x1877970397655040:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790972684.333840:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:23373:x1877970397655040:12345-0@lo:502:mount.lustre.0 Request processed in 154us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972684.333848:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790972684.333907:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790972684.333935:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397655040:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790972684.334166:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1790972684.334216:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1790972684.334236:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1790972684.334252:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1790972684.334269:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1790972684.334296:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1790972684.334315:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1790972684.334330:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1790972684.334347:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1790972684.334364:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1790972684.334381:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1790972684.334399:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1790972684.334414:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1790972684.334442:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1790972684.334463:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1790972684.334481:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1790972684.334500:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1790972684.334519:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1790972684.334537:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1790972684.334552:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1790972684.334567:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1790972684.334580:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1790972684.334591:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1790972684.334603:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1790972684.334615:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1790972684.334628:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1790972684.334641:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1790972684.334654:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1790972684.334689:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1790972684.334745:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1790972684.334764:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1790972684.334790:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1790972684.334805:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1790972684.334820:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1790972684.334839:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1790972684.334855:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1790972684.334869:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1790972684.334882:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1790972684.334896:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1790972684.334912:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1790972684.334931:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1790972684.334950:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1790972684.334966:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1790972684.334981:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1790972684.334995:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1790972684.337988:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1790972684.338058:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1790972684.338077:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1790972684.338138:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397655168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790972684.339468:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.339521:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790972684.340305:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397655168 00000100:00100000:2.0:1790972684.340316:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397655168 00000100:00100000:2.0:1790972684.340374:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790972684.340385:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:23373:x1877970397655168:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972684.340535:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:23373:x1877970397655168:12345-0@lo:502:mount.lustre.0 Request processed in 151us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972684.340543:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790972684.340772:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397655168:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972684.340994:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1790972684.341021:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1790972684.341055:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397655296:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972684.341095:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972684.341128:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b59e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790972684.341257:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397655296 00000100:00100000:3.0:1790972684.341263:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397655296 00000100:00100000:3.0:1790972684.341308:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790972684.341316:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:23373:x1877970397655296:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790972684.341395:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:23373:x1877970397655296:12345-0@lo:502:mount.lustre.0 Request processed in 79us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972684.341402:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790972684.341534:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397655296:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972684.341968:0:23373:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:2.0:1790972684.341980:0:23373:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1790972684.343405:0:23393:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1790972684.343422:0:23393:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff888e169a8000) 00000020:00000080:1.0:1790972684.343444:0:23393:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1790972684.343519:0:23393:0:(tgt_mount.c:153:server_get_mount()) get mount ffff888e02880000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1790972684.343523:0:23393:0:(tgt_mount.c:187:server_put_mount()) put mount ffff888e02880000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1790972684.343525:0:23393:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888e02880000 3 00010000:00080000:1.0:1790972684.343565:0:23393:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888d05dff800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.139@tcp at head 00010000:00010000:1.0:1790972684.351288:0:23393:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1790972684.351528:0:23393:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1790972684.351575:0:23393:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790972684.351588:0:23393:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd61f4faa13a11a37 00000100:00080000:1.0:1790972684.351598:0:23393:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790972684.351608:0:23393:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff888d05dff800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:1.0:1790972684.351645:0:23393:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e05488000 x1877970397655424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790972684.351705:0:23393:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790972684.351739:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1790972684.351748:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877970397655424:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1790972684.351751:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1790972684.351758:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1790972684.351761:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790972684.351847:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972684.352124:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397655424 00000100:00100000:2.0:1790972684.352137:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397655424 00000100:00100000:2.0:1790972684.352176:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790972684.352193:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1877970397655424:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790972684.352219:0:22643:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:2.0:1790972684.352251:0:22643:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd61f4faa13a11a3e 00000004:00100000:2.0:1790972684.352264:0:22643:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790972684.352301:0:22643:0:(import.c:65:import_set_state_nolock()) ffff888e04992000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790972684.352365:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1877970397655424:12345-0@lo:38:llog_process_th.0 Request processed in 180us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972684.352373:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790972684.352401:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff888e05488000 x1877970397655424/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790972694 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972684.352413:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790972684.352428:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1790972684.352435:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1790972684.352440:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790972684.352442:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d05dff800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1790972684.352450:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05488000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3637:1877970397655424:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1790972684.356608:0:23393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:3.0:1790972684.356729:0:23373:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1790972684.356764:0:23373:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790972684.356784:0:23373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cca00/0xd61f4faa13a11a22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a29 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.356797:0:23373:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3d3cca00/0xd61f4faa13a11a22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a29 expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790972684.356853:0:23373:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790972684.356855:0:23373:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790972684.356857:0:23373:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790972684.356858:0:23373:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790972684.356859:0:23373:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790972684.356861:0:23373:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790972684.356862:0:23373:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790972684.356864:0:23373:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790972684.356866:0:23373:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790972684.356870:0:23373:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:3.0:1790972684.356872:0:23373:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790972684.356874:0:23373:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1790972684.356875:0:23373:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790972684.356876:0:23373:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790972684.356877:0:23373:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790972684.356879:0:23373:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790972684.356880:0:23373:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790972684.356881:0:23373:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790972684.356882:0:23373:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790972684.356909:0:23373:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1790972684.356929:0:23373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397655552:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790972684.357006:0:23373:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972684.357053:0:23373:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e20349300 going to sleep for 11 seconds 00000100:00100000:1.0:1790972684.357548:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397655552 00000100:00100000:1.0:1790972684.357572:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397655552 00000100:00100000:1.0:1790972684.357628:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790972684.357638:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:23373:x1877970397655552:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1790972684.357695:0:22634:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1790972684.357709:0:22634:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1790972684.360836:0:22622:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1790972684.360872:0:22634:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790972684.360888:0:22634:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1790972684.360902:0:22658:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790972684.360909:0:22658:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790972684.360933:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.360954:0:22658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11942 expref: 18 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.360963:0:22658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e3ad43000/0xd61f4faa13a11a0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a06 expref: 18 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.360971:0:22658:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.361015:0:22658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e3ad43000/0xd61f4faa13a11a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11a06 expref: 18 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.361029:0:22658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e3ad43000/0xd61f4faa13a11a0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11a06 expref: 18 pid: 22634 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972684.361043:0:22658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397655680:0@lo:104: 00000100:00100000:0.0:1790972684.361106:0:22658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790972684.361161:0:22658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11942 expref: 18 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972684.361164:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397655680 00010000:00010000:0.0:1790972684.361172:0:22658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11949 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11942 expref: 18 pid: 22634 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972684.361174:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397655680 00000100:00100000:0.0:1790972684.361185:0:22658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397655808:0@lo:104: 00000100:00100000:0.0:1790972684.361207:0:22658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.361222:0:22658:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7840 going to sleep for 11 seconds 00000100:00100000:1.0:1790972684.361375:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397655808 00000100:00100000:1.0:1790972684.361379:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397655808 00000100:00100000:1.0:1790972684.361396:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790972684.361481:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+4:22658:x1877970397655680:12345-0@lo:104: 00010000:00010000:1.0:1790972684.361496:0:22626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11a0d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.361798:0:22626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790972684.361807:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+4:22658:x1877970397655680:12345-0@lo:104: Request processed in 327us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972684.361816:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790972684.361841:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790972684.361850:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+3:22658:x1877970397655808:12345-0@lo:104: 00010000:00010000:1.0:1790972684.361866:0:22626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11949 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.362203:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790972684.362211:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11a0d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.362220:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e15084400 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:3.0:1790972684.362224:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a11a0d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.362234:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a11a0d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790972684.362513:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a11a0d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972684.362521:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790972684.362637:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a0d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.362644:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790972684.362689:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a0d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.362696:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e15084400/0xd61f4faa13a11a06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a0d expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.362708:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972684.362711:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11949 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.362728:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e15085400 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:3.0:1790972684.362731:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a11949 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.362738:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a11949 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790972684.362743:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a11949 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972684.362748:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790972684.362762:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11949 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.362767:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790972684.362780:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11949 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.362786:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e15085400/0xd61f4faa13a11942 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11949 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972684.362799:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972684.362801:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972684.362803:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972684.362819:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3638:1877970397656064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790972684.362833:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397655936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790972684.362871:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.362900:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397656064 00000100:00100000:0.0:1790972684.362908:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397656064 00010000:00010000:0.0:1790972684.362935:0:22627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11949 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11942 expref: 19 pid: 22634 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972684.362975:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790972684.362984:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:3638:x1877970397656064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972684.362997:0:22627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972684.363002:0:22627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11949 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11942 expref: 19 pid: 22634 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.363021:0:22627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11949 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11942 expref: 19 pid: 22634 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.363035:0:22627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790972684.363069:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:3638:x1877970397656064:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972684.363076:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790972684.363178:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.363207:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397655936 00000100:00100000:0.0:1790972684.363211:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397655936 00010000:00010000:0.0:1790972684.363225:0:22629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e3ad43000/0xd61f4faa13a11a0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11a06 expref: 19 pid: 22634 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972684.363242:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790972684.363248:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:3641:x1877970397655936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972684.363254:0:22629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972684.363258:0:22629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e3ad43000/0xd61f4faa13a11a0d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11a06 expref: 19 pid: 22634 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.363265:0:22629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e3ad43000/0xd61f4faa13a11a0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11a06 expref: 19 pid: 22634 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.363287:0:22629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.363295:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790972684.363308:0:22629:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005897832s 00010000:00010000:0.0:1790972684.363318:0:22629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.363326:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.363333:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.363339:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.363344:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e15085a00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972684.363348:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.363355:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.363363:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972684.363374:0:22629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790972684.363404:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:3641:x1877970397655936:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972684.363411:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790972684.363440:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397655936:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790972684.363691:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3638:1877970397656064:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790972684.363759:0:22626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1790972684.363767:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa00380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+3:22658:x1877970397655808:12345-0@lo:104: Request processed in 1919us (2559us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972684.363774:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1790972684.364439:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3ad43000/0xd61f4faa13a11a0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11a06 expref: 18 pid: 22634 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972684.364454:0:22658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397655680:0@lo:104: 00010000:00010000:1.0:1790972684.364464:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11942 expref: 17 pid: 22634 timeout: 722 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972684.364473:0:22658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397655808:0@lo:104: 00010000:00010000:1.0:1790972684.364492:0:22658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.364501:0:22658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.364508:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972684.364514:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e15085a00/0xd61f4faa13a11a45 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972684.364600:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+16:23373:x1877970397655552:12345-0@lo:253:mount.lustre.0 Request processed in 6964us (7595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972684.364619:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1790972684.364739:0:23373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:23373:1877970397655552:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790972684.364749:0:23373:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1790972684.364752:0:23373:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790972684.364754:0:23373:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1790972684.364755:0:23373:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790972684.364757:0:23373:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790972684.364758:0:23373:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790972684.364759:0:23373:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790972684.364760:0:23373:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790972684.364762:0:23373:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790972684.364763:0:23373:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790972684.364775:0:23373:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1790972684.365690:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1790972684.378597:0:23373:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:3.0:1790972684.379034:0:23399:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790972684.379314:0:23373:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1790972684.379476:0:23399:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790972684.379689:0:23400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23400:1877970397656192:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790972684.379760:0:23400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.379796:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397656192 00000100:00100000:0.0:1790972684.379803:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397656192 00000100:00100000:0.0:1790972684.379839:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790972684.379846:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23400:x1877970397656192:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790972684.379913:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23400:x1877970397656192:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 67us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972684.379920:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790972684.379943:0:23400:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790972684.379980:0:23400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23400:1877970397656192:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1790972684.380005:0:23400:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1790972684.380027:0:23400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23400:1877970397656320:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790972684.380053:0:23400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.380066:0:23400:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e08b7bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790972684.380162:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397656320 00000100:00100000:2.0:1790972684.380166:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397656320 00000100:00100000:2.0:1790972684.380189:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790972684.380196:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23400:x1877970397656320:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1790972684.380304:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23400:x1877970397656320:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 109us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972684.380310:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:01000000:2.0:1790972684.380420:0:23373:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:2.0:1790972684.380453:0:23373:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790972684.381987:0:23373:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790972684.382005:0:23373:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1790972684.382083:0:23373:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790972684.384759:0:23399:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790972684.384841:0:23399:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:0.0:1790972684.385632:0:23400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23400:1877970397656320:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790972684.385751:0:23400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23400:1877970397656448:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1790972684.385806:0:23400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.385868:0:22653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397656448 00000100:00100000:0.0:1790972684.385875:0:22653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397656448 00000100:00100000:0.0:1790972684.385914:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790972684.385922:0:22653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23400:x1877970397656448:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1790972684.385982:0:22653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23400:x1877970397656448:12345-0@lo:900:lod0001_rec0000.0 Request processed in 60us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972684.385989:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790972684.386008:0:23400:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e08b7bd80 going to sleep for 11 seconds 00010000:00080000:0.0:1790972684.386028:0:23400:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff888e3fa03480 x1877970397656448/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790972700 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972684.386038:0:23400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23400:1877970397656448:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1790972684.386080:0:23400:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23400:1877970397656576:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790972684.386106:0:23400:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972684.386128:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397656576 00000100:00100000:0.0:1790972684.386131:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397656576 00000100:00100000:0.0:1790972684.386164:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790972684.386171:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23400:x1877970397656576:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1790972684.386223:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23400:x1877970397656576:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 53us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972684.386229:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790972684.386243:0:23400:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e08b7bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790972684.386253:0:23400:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23400:1877970397656576:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1790972684.386301:0:23400:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790972684.388420:0:23400:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1790972684.388505:0:23400:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1790972684.388510:0:23400:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000020:00080000:1.0:1790972684.390745:0:23398:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1790972684.390754:0:23398:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:00080000:2.0:1790972684.391400:0:23373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790972684.392814:0:23373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790972684.392868:0:23373:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1790972684.393038:0:23373:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790972684.393587:0:23373:0:(osd_handler.c:5587:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:3.0:1790972684.401799:0:23373:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1790972684.407566:0:23373:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790972684.407608:0:23373:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9f73c554b988 00100000:10000000:3.0:1790972684.407616:0:23373:0:(lfsck_lib.c:3084:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1790972684.409912:0:23373:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790972684.409942:0:23373:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790972684.409960:0:23373:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1790972684.409978:0:23373:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1790972684.411062:0:23373:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790972684.413560:0:23373:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790972684.853985:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972685.240455:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00000040:00080000:3.0:1790972685.431025:0:23395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1790972685.684774:0:22639:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790972685.684782:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff888e02880000 from 12 10000000:01000000:2.0:1790972685.684787:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790972685.684996:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972685.685027:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972685.685038:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972685.685063:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397656704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790972685.685138:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972685.685244:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3adef840 going to sleep for 11 seconds 00000100:00100000:3.0:1790972685.685787:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397656704 00000100:00100000:3.0:1790972685.686029:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397656704 00000100:00100000:3.0:1790972685.686079:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790972685.686088:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a740450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+16:22639:x1877970397656704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790972685.686102:0:22637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972685.686117:0:22637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3ad42600/0xd61f4faa13a11a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11a4c expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972685.686142:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3ad42600/0xd61f4faa13a11a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11a4c expref: 17 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972685.686168:0:22637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3ad42600/0xd61f4faa13a11a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a4c expref: 17 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972685.686177:0:22637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad42600, rc 0) 00000100:00100000:3.0:1790972685.686571:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a740450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:22639:x1877970397656704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 483us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972685.686579:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790972685.687603:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397656704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790972685.687627:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a53 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972685.687639:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11a53 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972685.687727:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397656832:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790972685.687778:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972685.687829:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3adef840 going to sleep for 11 seconds 00000100:00100000:1.0:1790972685.687997:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397656832 00000100:00100000:1.0:1790972685.688004:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397656832 00000100:00100000:1.0:1790972685.688055:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790972685.688064:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:22639:x1877970397656832:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790972685.688083:0:22634:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790972685.688100:0:22634:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790972685.688103:0:22634:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1790972685.688196:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:22639:x1877970397656832:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972685.688204:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790972685.688247:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397656832:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790972685.688310:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790972685.688318:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a53 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972685.688326:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a53 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972685.688346:0:22639:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790972685.688348:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff888e2d3c6000 from 12 10000000:01000000:2.0:1790972685.688351:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790972685.688374:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972685.688382:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972685.688390:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972685.688403:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397656960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790972685.688427:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972685.688453:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3adef840 going to sleep for 11 seconds 00000100:00100000:3.0:1790972685.688607:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397656960 00000100:00100000:3.0:1790972685.688613:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397656960 00000100:00100000:3.0:1790972685.688738:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790972685.688747:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:22639:x1877970397656960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790972685.688756:0:22637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972685.688768:0:22637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11a61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11a5a expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972685.688787:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11a5a expref: 18 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972685.688806:0:22637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a5a expref: 18 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972685.688815:0:22637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad43200, rc 0) 00000100:00100000:3.0:1790972685.688851:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:22639:x1877970397656960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972685.688857:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790972685.688953:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397656960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790972685.688965:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a61 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972685.688974:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11a61 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972685.689017:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397657088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790972685.689045:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972685.690282:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3adef840 going to sleep for 11 seconds 00000100:00100000:1.0:1790972685.691264:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397657088 00000100:00100000:1.0:1790972685.691285:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397657088 00000100:00100000:1.0:1790972685.691435:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790972685.691446:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a740050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:22639:x1877970397657088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790972685.691484:0:22634:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790972685.691499:0:22634:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790972685.691502:0:22634:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1790972685.691643:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a740050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:22639:x1877970397657088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 198us (2596us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972685.691650:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790972685.691656:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397657088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790972685.691726:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790972685.691739:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a61 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972685.691751:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a61 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972685.888079:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972686.261399:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00000040:00080000:3.0:1790972686.453619:0:23395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790972686.900896:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972687.285276:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00010000:00010000:2.0:1790972687.925130:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972688.310015:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00010000:00010000:3.0:1790972688.951894:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790972689.027966:0:23643:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1790972689.333710:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 0 seconds 00000100:00100000:2.0:1790972689.654078:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397657216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790972689.654148:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790972689.654436:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790972689.654441:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1790972689.654444:0:471:0:(import.c:65:import_set_state_nolock()) ffff888e3af95000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790972689.654456:0:471:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff888e3af95000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1790972689.654493:0:471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3d522d80 x1877970397657472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790972689.654509:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972689.654514:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790972689.654516:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972689.654520:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790972689.654531:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972689.654534:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790972689.654536:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972689.654539:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790972689.654635:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397657344:0@lo:400:kworker.0 00000100:00100000:2.0:1790972689.654695:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972689.654719:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790972689.654725:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877970397657600:0@lo:400:kworker.0 00000100:00100000:2.0:1790972689.654747:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972689.654775:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397657472:0@lo:38:kworker.0 00000100:00100000:2.0:1790972689.654798:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972689.654813:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877970397657728:0@lo:400:kworker.0 00000100:00100000:3.0:1790972689.654857:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972689.654888:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397657344 00000100:00100000:3.0:1790972689.654896:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397657344 00000100:00100000:3.0:1790972689.654944:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790972689.654953:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:3640:x1877970397657344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972689.655145:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:3640:x1877970397657344:12345-0@lo:400:kworker.0 Request processed in 192us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972689.655153:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790972689.655193:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397657600 00000100:00100000:3.0:1790972689.655196:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397657600 00000100:00100000:3.0:1790972689.655218:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397657728 00000100:00100000:3.0:1790972689.655221:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397657728 00000100:00100000:3.0:1790972689.655251:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790972689.655262:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877970397657600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972689.655295:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d523b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877970397657600:12345-0@lo:400:kworker.0 Request processed in 34us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972689.655301:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790972689.655312:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790972689.655318:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877970397657728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972689.655718:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877970397657728:12345-0@lo:400:kworker.0 Request processed in 399us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972689.655725:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790972689.655771:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff888e3d522680 x1877970397657728/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972689.655784:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877970397657728:0@lo:400:kworker.0 00010000:00080000:3.0:1790972689.656247:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff888e3d523480 x1877970397657600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972689.656303:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d523480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877970397657600:0@lo:400:kworker.0 00000100:00100000:3.0:1790972689.656318:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397657344:0@lo:400:kworker.0 00000100:00100000:0.0:1790972689.657620:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397657216 00000100:00100000:0.0:1790972689.657632:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397657216 00000100:00100000:0.0:1790972689.657699:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397657472 00000100:00100000:0.0:1790972689.657703:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397657472 00000100:00100000:0.0:1790972689.657735:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790972689.657744:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397657216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1790972689.657798:0:22647:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790972689.657868:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d520700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397657216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 126us (3720us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972689.658234:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790972689.658263:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790972689.658267:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3637:x1877970397657472:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1790972689.658291:0:22647:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 627 last 0 00000020:00000080:0.0:1790972689.658322:0:22647:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd61f4faa13a11a68 00000004:00100000:0.0:1790972689.658337:0:22647:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1790972689.658342:0:22647:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1790972689.658511:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397657216:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1790972689.670508:0:22647:0:(import.c:65:import_set_state_nolock()) ffff888e3f6d0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790972689.670615:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d520e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1877970397657472:12345-0@lo:38:kworker.0 Request processed in 12343us (15813us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972689.670626:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1790972689.671020:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790972689.671030:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1790972689.671036:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790972689.671039:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e3af95000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1790972689.671063:0:3637:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ef8f4bae): req@ffff888e3d521180 x1877970397650048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972689.671083:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397657472:0@lo:38:kworker.0 00000100:00100000:3.0:1790972689.671335:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397657856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790972689.671386:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972689.671966:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397657856 00000100:00100000:2.0:1790972689.671974:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397657856 00000100:00100000:2.0:1790972689.672025:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790972689.672035:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1877970397657856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790972689.672066:0:22648:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790972689.672120:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3639:x1877970397657856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972689.672128:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790972689.672177:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397657856:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790972689.672999:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972689.673033:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972689.673128:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397650048 00000100:00100000:3.0:1790972689.673134:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397650048 00000100:00100000:3.0:1790972689.673168:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790972689.673175:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22683:x1877970397650048:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790972689.673262:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22683:x1877970397650048:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 87us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972689.673270:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790972689.673303:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22683:1877970397650048:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1790972689.673352:0:22683:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1790972689.675324:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d0700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22683:1877970397657984:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790972689.675692:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972689.675731:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d07bb8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1790972689.676244:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397657984 00000100:00100000:3.0:1790972689.676254:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397657984 00000100:00100000:3.0:1790972689.676309:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790972689.676318:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22683:x1877970397657984:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1790972689.676500:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d522d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22683:x1877970397657984:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 182us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972689.676507:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790972689.676606:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d0700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22683:1877970397657984:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790972689.676747:0:22683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22683:1877970397658112:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1790972689.676776:0:22683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972689.676796:0:22683:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3aaf16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790972689.677016:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397658112 00000100:00100000:1.0:1790972689.677022:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397658112 00000100:00100000:1.0:1790972689.677056:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790972689.677064:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22683:x1877970397658112:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1790972689.677132:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d521180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22683:x1877970397658112:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972689.677138:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790972689.677517:0:22683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22683:1877970397658112:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1790972689.677563:0:22683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790972689.683252:0:22683:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790972689.683327:0:22683:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 21, retries 0 00000004:00080000:3.0:1790972689.683333:0:22683:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1790972689.957586:0:23695:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790972689.958080:0:23695:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790972689.976762:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790972690.294443:0:22676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1790972690.928167:0:23745:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790972690.928380:0:23745:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1790972690.997499:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972692.027969:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790972692.052104:0:23793:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef2614060 20000000:00000080:1.0:1790972692.052121:0:23793:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff888e1d27e400 uarg=0000000000000000 20000000:01000000:1.0:1790972692.052163:0:23793:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1790972692.052170:0:23793:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1790972692.052249:0:23793:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790972692.052643:0:23794:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1790972692.053132:0:23793:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1790972692.064354:0:23793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790972692.064456:0:23793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972692.064477:0:23793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11911 expref: 17 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972692.064485:0:23793:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11a1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a14 expref: 17 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972692.064509:0:23793:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972692.064655:0:23793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11a14 expref: 17 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972692.064835:0:23793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11a14 expref: 17 pid: 22636 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972692.064852:0:23793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23793:1877970397658240:0@lo:104: 00000100:00100000:1.0:1790972692.064919:0:23793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790972692.064979:0:23793:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11911 expref: 17 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972692.064987:0:23793:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11918 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11911 expref: 17 pid: 22637 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972692.064996:0:23793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23793:1877970397658368:0@lo:104: 00000100:00100000:1.0:1790972692.065017:0:23793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972692.065041:0:23793:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3955d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790972692.065259:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397658240 00000100:00100000:0.0:1790972692.065268:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397658240 00000100:00100000:0.0:1790972692.065302:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397658368 00000100:00100000:0.0:1790972692.065304:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397658368 00000100:00100000:0.0:1790972692.065316:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790972692.065323:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05489500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+4:23793:x1877970397658240:12345-0@lo:104: 00010000:00010000:0.0:1790972692.065334:0:22626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11a1b expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.065399:0:22626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790972692.065406:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05489500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+4:23793:x1877970397658240:12345-0@lo:104: Request processed in 83us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972692.065413:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790972692.065430:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790972692.065436:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05488a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+3:23793:x1877970397658368:12345-0@lo:104: 00010000:00010000:0.0:1790972692.065443:0:22626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11918 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972692.065465:0:23793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23793:1877970397658240:0@lo:104: 00010000:00010000:0.0:1790972692.065472:0:22626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790972692.065474:0:23793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23793:1877970397658368:0@lo:104: 00000100:00100000:0.0:1790972692.065477:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05488a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+3:23793:x1877970397658368:12345-0@lo:104: Request processed in 43us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972692.065483:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1790972692.065496:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790972692.065498:0:23793:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.065502:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11a1b expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.065508:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e09febe00 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:0.0:1790972692.065512:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a11a1b expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.065521:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a11a1b expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790972692.065528:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a11a1b expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972692.065533:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790972692.065578:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a1b expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.065585:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790972692.065612:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a1b expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.065618:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11a14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a1b expref: -99 pid: 23373 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.065632:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790972692.065635:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11918 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.065641:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad42e00 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:0.0:1790972692.065643:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a11918 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972692.065650:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397658496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972692.065650:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a11918 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790972692.065656:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a11918 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972692.065678:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790972692.065692:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11918 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.065698:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790972692.065703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790972692.065704:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11918 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.065720:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3ad42e00/0xd61f4faa13a11911 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11918 expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972692.065728:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790972692.065734:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397658624:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972692.065734:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972692.065735:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972692.065737:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790972692.065754:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790972692.065855:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972692.065869:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397658496 00000100:00100000:0.0:1790972692.065874:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397658496 00010000:00010000:0.0:1790972692.065891:0:22629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11a14 expref: 18 pid: 22636 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972692.065916:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397658624 00000100:00100000:0.0:1790972692.065919:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397658624 00010000:00010000:0.0:1790972692.065931:0:22629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11918 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11911 expref: 19 pid: 22637 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972692.065942:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790972692.065948:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:3640:x1877970397658496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972692.065958:0:22629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972692.065963:0:22629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11a1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11a14 expref: 19 pid: 22636 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972692.065969:0:22628:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1790972692.065973:0:22629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11a1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11a14 expref: 19 pid: 22636 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972692.065975:0:22628:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1790972692.065985:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11a1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11a14 expref: 19 pid: 22636 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066008:0:22629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790972692.066044:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:3640:x1877970397658496:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972692.066050:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790972692.066061:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790972692.066066:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:3640:x1877970397658624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972692.066073:0:22629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972692.066077:0:22629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11918 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11911 expref: 17 pid: 22637 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066085:0:22629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11911 expref: 17 pid: 22637 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066094:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11918 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11911 expref: 17 pid: 22637 timeout: 730 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066105:0:22629:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066112:0:22629:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066122:0:22629:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066129:0:22629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066136:0:22629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066149:0:22629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066154:0:22629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e09feba00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972692.066157:0:22629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066165:0:22629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972692.066217:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397658496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790972692.066247:0:23793:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066253:0:22629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972692.066255:0:23793:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972692.066262:0:23793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e09feba00/0xd61f4faa13a11a6f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972692.066263:0:22629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790972692.066291:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+16:3640:x1877970397658624:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972692.066296:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790972692.066328:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397658624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790972693.048858:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972693.748891:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972678/real 1790972678] req@ffff888e3d521f80 x1877970397651072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972693 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972693.748922:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e3d521f80 x1877970397651072/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972693 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972693.748933:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972678/real 1790972678] req@ffff888e3d522a00 x1877970397651200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972693 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972693.748943:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e3d522a00 x1877970397651200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972693 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790972693.748963:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e394b7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790972693.748986:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790972693.748990:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397651072:0@lo:8:kworker.0 00000100:00080000:2.0:1790972693.748995:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d07d6a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790972693.749000:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790972693.749003:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d522a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397651200:0@lo:8:kworker.0 00000100:00080000:0.0:1790972693.749100:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972693.749105:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00100000:1.0:1790972693.749106:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397658880:0@lo:400:kworker.0 00000100:00080000:0.0:1790972693.749108:0:471:0:(import.c:65:import_set_state_nolock()) ffff888e394b7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972693.749113:0:471:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 616 00000100:00080000:0.0:1790972693.749118:0:471:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790972693.749129:0:471:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff888e394b7000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972693.749147:0:471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa01500 x1877970397659008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790972693.749160:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972693.749174:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790972693.749186:0:471:0:(import.c:65:import_set_state_nolock()) ffff888d07d6a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972693.749189:0:471:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 616 00000100:00080000:0.0:1790972693.749192:0:471:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790972693.749196:0:471:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff888d07d6a000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972693.749218:0:471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa01880 x1877970397659136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790972693.749232:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790972693.749247:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972693.749251:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790972693.749253:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972693.749256:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790972693.749271:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790972693.749275:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877970397659264:0@lo:400:kworker.0 00000100:00100000:1.0:1790972693.749276:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3639:1877970397658752:0@lo:400:kworker.0 00000100:00100000:1.0:1790972693.749302:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972693.749303:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972693.749323:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877970397659520:0@lo:400:kworker.0 00000100:00100000:0.0:1790972693.749324:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790972693.749340:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397659392:0@lo:400:kworker.0 00000100:00100000:1.0:1790972693.749346:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972693.749360:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972693.749374:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397658880 00000100:00100000:1.0:1790972693.749382:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397658880 00000100:00100000:0.0:1790972693.749385:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397658752 00000100:00100000:0.0:1790972693.749388:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397658752 00000100:00100000:1.0:1790972693.749418:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397659392 00000100:00100000:1.0:1790972693.749421:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397659392 00000100:00100000:0.0:1790972693.749421:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1790972693.749428:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+16:3639:x1877970397658752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972693.749433:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790972693.749438:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1877970397658880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972693.749475:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05489c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3639:x1877970397658880:12345-0@lo:400:kworker.0 Request processed in 38us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972693.749475:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+16:3639:x1877970397658752:12345-0@lo:400:kworker.0 Request processed in 46us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972693.749483:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790972693.749483:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790972693.749511:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790972693.749512:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397659264 00000100:00100000:1.0:1790972693.749516:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397659392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972693.749521:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397659264 00000100:00100000:0.0:1790972693.749544:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397659520 00000100:00100000:0.0:1790972693.749546:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397659520 00000100:00100000:1.0:1790972693.749547:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397659392:12345-0@lo:400:kworker.0 Request processed in 31us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972693.749552:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790972693.749558:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790972693.749563:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877970397659264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972693.749571:0:22643:0:(service.c:3485:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790972693.749577:0:22643:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1790972693.749592:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877970397659264:12345-0@lo:400:kworker.0 Request processed in 28us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972693.749597:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790972693.749609:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790972693.749614:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877970397659520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972693.749636:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3639:x1877970397659520:12345-0@lo:400:kworker.0 Request processed in 23us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972693.749641:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790972693.749698:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397659392:0@lo:400:kworker.0 00010000:00080000:0.0:1790972693.749709:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff888e3fa01f80 x1877970397659264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972693.749717:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877970397659264:0@lo:400:kworker.0 00000100:00100000:0.0:1790972693.749738:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397659008:0@lo:8:kworker.0 00000400:00000100:0.0:1790972693.749761:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877970397659008 offset 0 length 520: 4 00000100:00100000:0.0:1790972693.749774:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397659136:0@lo:8:kworker.0 00000400:00000100:0.0:1790972693.749787:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877970397659136 offset 0 length 520: 4 00000100:00100000:0.0:1790972693.749812:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3639:1877970397658752:0@lo:400:kworker.0 00010000:00080000:0.0:1790972693.749823:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff888e3fa02680 x1877970397659520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972693.749844:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3639:1877970397659520:0@lo:400:kworker.0 00000100:00100000:0.0:1790972693.749855:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397658880:0@lo:400:kworker.0 10000000:01000000:1.0:1790972693.889220:0:22639:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790972693.889227:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff888e02880000 from 13 10000000:01000000:1.0:1790972693.889233:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790972693.889281:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972693.889293:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972693.889304:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972693.889331:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397659648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790972693.889401:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972693.889448:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3955d0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972693.889562:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397659648 00000100:00100000:3.0:1790972693.889571:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397659648 00000100:00100000:3.0:1790972693.889623:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790972693.889632:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+16:22639:x1877970397659648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790972693.889646:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972693.889998:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3ad43c00/0xd61f4faa13a11a7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11a76 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972693.890024:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3ad43c00/0xd61f4faa13a11a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11a76 expref: 17 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972693.890036:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3ad43c00/0xd61f4faa13a11a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a76 expref: 17 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972693.890045:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad43c00, rc 0) 00000100:00100000:3.0:1790972693.890101:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:22639:x1877970397659648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 470us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972693.890109:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790972693.890204:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397659648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790972693.890228:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a7d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972693.890248:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11a7d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972693.890330:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397659776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790972693.890360:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972693.890390:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3955d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790972693.890439:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397659776 00000100:00100000:0.0:1790972693.890445:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397659776 00000100:00100000:0.0:1790972693.890481:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790972693.890489:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:22639:x1877970397659776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790972693.890612:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:22639:x1877970397659776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972693.890620:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790972693.890707:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397659776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790972693.890737:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397659904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790972693.890775:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972693.891024:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d07bb8600 going to sleep for 11 seconds 00000100:00100000:0.0:1790972693.891063:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397659904 00000100:00100000:0.0:1790972693.891067:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397659904 00000100:00100000:0.0:1790972693.891099:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790972693.891106:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:22639:x1877970397659904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790972693.891185:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:22639:x1877970397659904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972693.891192:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790972693.891242:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397659904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790972693.893162:0:23873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1790972693.893868:0:22639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1790972693.893899:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790972693.893910:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a7d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972693.893921:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a7d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972693.893932:0:22639:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790972693.893934:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff888e2d3c6000 from 13 10000000:01000000:3.0:1790972693.893937:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790972693.893977:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972693.893986:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972693.894008:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972693.894033:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397660032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790972693.894101:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972693.894154:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d07bb8240 going to sleep for 11 seconds 00000100:00100000:0.0:1790972693.894271:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397660032 00000100:00100000:0.0:1790972693.894279:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397660032 00000100:00100000:0.0:1790972693.894329:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790972693.894339:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a740c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+17:22639:x1877970397660032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790972693.894354:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790972693.894367:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e15084400/0xd61f4faa13a11a8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11a84 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972693.894398:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e15084400/0xd61f4faa13a11a8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11a84 expref: 18 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972693.894410:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e15084400/0xd61f4faa13a11a8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a84 expref: 18 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972693.894418:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e15084400, rc 0) 00000100:00100000:0.0:1790972693.894466:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a740c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:22639:x1877970397660032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972693.894473:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790972693.894700:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397660032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790972693.894717:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a8b expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972693.894724:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11a8b expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972693.897852:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397660160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790972693.897936:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972693.898087:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397660160 00000100:00100000:1.0:1790972693.898096:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397660160 00000100:00100000:1.0:1790972693.898149:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790972693.898158:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a742c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:22639:x1877970397660160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790972693.898297:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a742c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:22639:x1877970397660160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972693.898307:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790972693.898364:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3955dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790972693.898390:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397660160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790972693.898440:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397660288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790972693.898494:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972693.898514:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397660288 00000100:00100000:1.0:1790972693.898518:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397660288 00000100:00100000:1.0:1790972693.898541:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790972693.898547:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:22639:x1877970397660288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790972693.898617:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:22639:x1877970397660288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972693.898624:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790972693.898919:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3955dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790972693.898933:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397660288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790972693.901080:0:23874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790972693.909932:0:22639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790972693.909973:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790972693.909986:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a8b expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972693.910008:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11a8b expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972694.069059:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972694.775898:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972684/real 1790972684] req@ffff888e05489f80 x1877970397653632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972694 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972694.775926:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e05489f80 x1877970397653632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972694 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972694.775936:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972684/real 1790972684] req@ffff888e0548aa00 x1877970397653504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972694 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972694.775962:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e0548aa00 x1877970397653504/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972694 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790972694.775981:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d05dfd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790972694.776002:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790972694.776006:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397653632:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1790972694.776011:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e20346800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790972694.776016:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1790972694.776019:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397653504:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1790972694.776141:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790972694.776162:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397660416:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790972694.776235:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972694.776279:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397660416 00000100:00100000:3.0:1790972694.776288:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397660416 00000100:00100000:3.0:1790972694.776335:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790972694.776345:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1877970397660416:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790972694.776380:0:23382:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790972694.776427:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3638:x1877970397660416:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972694.776435:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790972694.776483:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397660416:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1790972694.776553:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972694.776558:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790972694.776560:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972694.776563:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790972694.776582:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972694.776585:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790972694.776588:0:37:0:(import.c:65:import_set_state_nolock()) ffff888e20346800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790972694.776592:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 622 00000100:00080000:3.0:1790972694.776597:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790972694.776604:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff888e20346800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1790972694.776622:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3a7d0700 x1877970397660928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790972694.776647:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972694.776650:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790972694.776651:0:37:0:(import.c:65:import_set_state_nolock()) ffff888d05dfd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790972694.776654:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 622 00000100:00080000:3.0:1790972694.776657:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1790972694.776684:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff888d05dfd000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1790972694.776698:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3a7d1f80 x1877970397661056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790972694.777375:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397660800:0@lo:400:kworker.0 00000100:00100000:3.0:1790972694.777422:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972694.777450:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790972694.777456:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877970397661184:0@lo:400:kworker.0 00000100:00100000:3.0:1790972694.777482:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972694.777800:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397660544:0@lo:400:kworker.0 00000100:00100000:1.0:1790972694.777848:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972694.777855:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397660928:0@lo:8:kworker.0 00000400:00000100:2.0:1790972694.777886:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877970397660928 offset 0 length 520: 4 00000100:00100000:1.0:1790972694.777890:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790972694.777901:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877970397660672:0@lo:400:kworker.0 00000100:00100000:2.0:1790972694.777907:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397661056:0@lo:8:kworker.0 00000400:00000100:2.0:1790972694.777935:0:3637:0:(lib-move.c:4372:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877970397661056 offset 0 length 520: 4 00000100:00100000:1.0:1790972694.777941:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972694.778032:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397661184 00000100:00100000:1.0:1790972694.778039:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397661184 00000100:00100000:1.0:1790972694.778076:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397660672 00000100:00100000:1.0:1790972694.778079:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397660672 00000100:00100000:2.0:1790972694.778100:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397661312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790972694.778128:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790972694.778134:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972694.778142:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877970397661184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972694.778180:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397660800 00000100:00100000:2.0:1790972694.778185:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397660800 00000100:00100000:2.0:1790972694.778221:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397661312 00000100:00100000:2.0:1790972694.778224:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397661312 00000100:00100000:2.0:1790972694.778237:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790972694.778243:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1877970397660800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972694.778286:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3638:x1877970397660800:12345-0@lo:400:kworker.0 Request processed in 43us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972694.778293:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790972694.778315:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790972694.778321:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397661312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790972694.778343:0:23382:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790972694.778380:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d522a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397661312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 58us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972694.778386:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790972694.778421:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05489180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397661312:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790972694.778449:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397660800:0@lo:400:kworker.0 00000100:00100000:0.0:1790972694.778589:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790972694.778599:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877970397660672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972694.778612:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877970397661184:12345-0@lo:400:kworker.0 Request processed in 473us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972694.778624:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790972694.778646:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877970397660672:12345-0@lo:400:kworker.0 Request processed in 47us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972694.778654:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790972694.778858:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397660544 00000100:00100000:3.0:1790972694.778863:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397660544 00000100:00100000:3.0:1790972694.778907:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1790972694.778914:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:3640:x1877970397660544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972694.778948:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:3640:x1877970397660544:12345-0@lo:400:kworker.0 Request processed in 35us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972694.778954:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1790972694.779404:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff888e3a7d1500 x1877970397660672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972694.779417:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877970397660672:0@lo:400:kworker.0 00000100:00100000:2.0:1790972694.779426:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397660544:0@lo:400:kworker.0 00010000:00080000:2.0:1790972694.779461:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff888e3a7d2300 x1877970397661184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972710 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972694.779470:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877970397661184:0@lo:400:kworker.0 00010000:00010000:0.0:1790972695.093185:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790972695.801979:0:23374:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1790972696.117857:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790972696.693349:0:23395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790972697.142213:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972698.169210:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790972698.655354:0:24143:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790972698.655360:0:24143:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1790972698.655361:0:24143:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1790972698.655502:0:24143:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff888d05dff000 00000020:01000004:3.0:1790972698.655517:0:24143:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790972698.655532:0:24143:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1790972698.655545:0:24143:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff888d0695cd40) 00000020:00000080:3.0:1790972698.655562:0:24143:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1790972698.721783:0:24143:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790972698.722904:0:24143:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1790972698.723182:0:24143:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790972698.723543:0:24143:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790972698.723774:0:24143:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790972698.723975:0:24143:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1790972698.724200:0:24143:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1790972698.731212:0:24143:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1790972698.731461:0:24143:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790972698.731475:0:24143:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790972698.731492:0:24143:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd61f4faa13a11a99 00000020:01000004:2.0:1790972698.731500:0:24143:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1790972698.731523:0:24143:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790972698.731526:0:24143:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790972698.731532:0:24143:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790972698.731537:0:24143:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790972698.731548:0:24143:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff888e3ad999c0) 00000020:00000080:2.0:1790972698.731559:0:24143:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1790972698.732741:0:24143:0:(service.c:173:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790972698.732901:0:24143:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790972698.732907:0:24143:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1790972698.740410:0:24143:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1790972698.740423:0:24143:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1790972698.740800:0:24143:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1790972698.740806:0:24143:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1790972698.742397:0:24143:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790972698.742587:0:24143:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1790972698.742593:0:24143:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1790972698.743478:0:24143:0:(service.c:3485:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1790972698.743487:0:24143:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1790972698.762037:0:24143:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790972698.762456:0:24143:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790972698.762464:0:24143:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1790972698.763790:0:24143:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790972698.763803:0:24143:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1790972698.765383:0:24143:0:(service.c:3485:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790972698.765396:0:24143:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1790972698.767478:0:24143:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790972698.767658:0:24143:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1790972698.767708:0:24143:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1790972698.768564:0:24143:0:(service.c:3485:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1790972698.768572:0:24143:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1790972698.806022:0:24143:0:(service.c:173:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790972698.806258:0:24143:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1790972698.806265:0:24143:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1790972698.807509:0:24143:0:(service.c:3485:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1790972698.807620:0:24143:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790972698.810575:0:24143:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790972698.810608:0:24143:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1790972698.810615:0:24143:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790972698.834750:0:24143:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790972698.834791:0:24143:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.139@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1790972698.835970:0:24143:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790972698.835973:0:24143:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790972698.835975:0:24143:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972698.835976:0:24143:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972698.835977:0:24143:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972698.835979:0:24143:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972698.835981:0:24143:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790972698.835983:0:24143:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972698.835984:0:24143:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790972698.835988:0:24143:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1790972698.835991:0:24143:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790972698.835993:0:24143:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790972698.835994:0:24143:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972698.835995:0:24143:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972698.835996:0:24143:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972698.835997:0:24143:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972698.835998:0:24143:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790972698.835999:0:24143:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972698.836011:0:24143:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790972698.836039:0:24143:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790972698.836060:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397661440:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790972698.836145:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.836203:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1790972698.836694:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397661440 00000100:00100000:0.0:1790972698.836703:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397661440 00000100:00100000:0.0:1790972698.836762:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1790972698.836780:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:24143:x1877970397661440:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790972698.836823:0:22634:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790972698.836826:0:22634:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1790972698.836830:0:22634:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1790972698.837754:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:24143:x1877970397661440:12345-0@lo:253:mount.lustre.0 Request processed in 971us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972698.837764:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1790972698.838001:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397661440:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790972698.838016:0:24143:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790972698.838019:0:24143:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790972698.838021:0:24143:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790972698.838022:0:24143:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972698.838023:0:24143:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972698.838024:0:24143:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972698.838025:0:24143:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972698.838027:0:24143:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790972698.838028:0:24143:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972698.838029:0:24143:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790972698.838049:0:24143:0:(tgt_mount.c:101:server_register_mount()) register mount ffff888d05dff000 from lustre-OST0000 10000000:01000000:2.0:1790972698.838104:0:24143:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1790972698.838107:0:24143:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790972698.838115:0:24143:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff888d0695b380 local copy 00010000:00010000:2.0:1790972698.838125:0:24143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972698.838233:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397661568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972698.838272:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.838353:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3600 going to sleep for 11 seconds 00000100:00100000:1.0:1790972698.839496:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397661568 00000100:00100000:1.0:1790972698.839506:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397661568 00000100:00100000:1.0:1790972698.839756:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790972698.839767:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:24143:x1877970397661568:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790972698.840556:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:24143:x1877970397661568:12345-0@lo:501:mount.lustre.0 Request processed in 790us (2282us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790972698.840565:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790972698.841344:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397661568:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790972698.841373:0:24143:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790972698.841406:0:24143:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790972698.841415:0:24143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.841434:0:24143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972698.841465:0:24143:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff888d05dff000 10000000:01000000:2.0:1790972698.841470:0:24143:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790972698.841475:0:24143:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790972698.841478:0:24143:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790972698.841482:0:24143:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790972698.841485:0:24143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790972698.841515:0:24143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd200/0xd61f4faa13a11aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.841524:0:24143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd200/0xd61f4faa13a11aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.841533:0:24143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd200/0xd61f4faa13a11aa7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972698.841552:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397661696:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790972698.841597:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.841706:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3600 going to sleep for 11 seconds 00000100:00100000:1.0:1790972698.842216:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397661696 00000100:00100000:1.0:1790972698.842223:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397661696 00000100:00100000:1.0:1790972698.842271:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790972698.842280:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+18:24143:x1877970397661696:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790972698.842292:0:22636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972698.842305:0:22636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11aae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11aa7 expref: -99 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.842329:0:22636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11aa7 expref: 19 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.842340:0:22636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e09feae00/0xd61f4faa13a11aae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11aa7 expref: 19 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.842362:0:22636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e09feae00, rc 0) 00000100:00100000:1.0:1790972698.842410:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:24143:x1877970397661696:12345-0@lo:101:mount.lustre.0 Request processed in 131us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972698.842416:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1790972698.842525:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397661696:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790972698.842541:0:24143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd200/0xd61f4faa13a11aa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11aae expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.842549:0:24143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd200/0xd61f4faa13a11aa7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11aae expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790972698.843706:0:24143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1790972698.844554:0:24143:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790972698.846610:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1790972698.846655:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1790972698.846716:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1790972698.846733:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1790972698.846746:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1790972698.846757:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1790972698.846790:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1790972698.846805:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1790972698.846819:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1790972698.846833:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1790972698.846846:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1790972698.846858:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1790972698.846881:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1790972698.846887:0:24143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1790972698.846984:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397661824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972698.847050:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.847088:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1790972698.847297:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397661824 00000100:00100000:0.0:1790972698.847305:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397661824 00000100:00100000:0.0:1790972698.847350:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790972698.847360:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:24143:x1877970397661824:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790972698.847511:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:24143:x1877970397661824:12345-0@lo:501:mount.lustre.0 Request processed in 153us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972698.847519:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1790972698.847797:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397661824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972698.847831:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397661952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790972698.847872:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.847961:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1790972698.848048:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397661952 00000100:00100000:0.0:1790972698.848053:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397661952 00000100:00100000:0.0:1790972698.848183:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1790972698.848192:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:24143:x1877970397661952:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790972698.848748:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:24143:x1877970397661952:12345-0@lo:503:mount.lustre.0 Request processed in 555us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972698.848755:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790972698.848906:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397661952:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790972698.849360:0:24143:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790972698.849432:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972698.849485:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.850377:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d62e180 going to sleep for 11 seconds 00000100:00100000:3.0:1790972698.850465:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397662080 00000100:00100000:3.0:1790972698.850472:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397662080 00000100:00100000:3.0:1790972698.850513:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1790972698.850521:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:24143:x1877970397662080:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790972698.851198:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:24143:x1877970397662080:12345-0@lo:502:mount.lustre.0 Request processed in 677us (1711us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972698.851207:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1790972698.851306:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972698.851517:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1790972698.851550:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1790972698.851566:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1790972698.851579:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1790972698.851594:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1790972698.851606:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1790972698.851621:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1790972698.851653:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1790972698.851695:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1790972698.851711:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1790972698.851724:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1790972698.851737:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1790972698.851770:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972698.851813:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.851835:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3600 going to sleep for 11 seconds 00000100:00100000:3.0:1790972698.851948:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397662208 00000100:00100000:3.0:1790972698.851954:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397662208 00000100:00100000:3.0:1790972698.851980:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1790972698.851987:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:24143:x1877970397662208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972698.852162:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972698.852213:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1790972698.852222:0:24143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000100:00100000:3.0:1790972698.852534:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:24143:x1877970397662208:12345-0@lo:502:mount.lustre.0 Request processed in 545us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972698.852542:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:01000000:2.0:1790972698.852901:0:24160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790972698.852908:0:24160:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1790972698.852915:0:24160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972698.852917:0:24160:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1790972698.852922:0:24160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790972698.852937:0:24160:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff888e3ad9b380) 00000020:00000080:2.0:1790972698.852959:0:24160:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790972698.852964:0:24160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790972698.853036:0:24160:0:(tgt_mount.c:153:server_get_mount()) get mount ffff888d05dff000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1790972698.853044:0:24160:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790972698.853050:0:24160:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd61f4faa13a11abc 00010000:00010000:2.0:1790972698.863726:0:24160:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:2.0:1790972698.865467:0:24160:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:3.0:1790972698.869225:0:24160:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1790972698.873567:0:24160:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1790972698.873579:0:24160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972698.873585:0:24160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972698.873587:0:24160:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1790972698.873591:0:24160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1790972698.873594:0:24160:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1790972698.873595:0:24160:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790972698.873596:0:24160:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1790972698.873598:0:24160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1790972698.873600:0:24160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972698.873601:0:24160:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1790972698.873603:0:24160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972698.873606:0:24160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972698.873607:0:24160:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790972698.873624:0:24160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790972698.873626:0:24160:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790972698.873627:0:24160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972698.873630:0:24160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972698.873631:0:24160:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1790972698.873633:0:24160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972698.873635:0:24160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972698.873637:0:24160:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790972698.873639:0:24160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1790972698.873695:0:24160:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972698.873699:0:24160:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972698.873700:0:24160:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790972698.873704:0:24160:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1790972698.874450:0:24143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1790972698.874484:0:24143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790972698.874511:0:24143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd200/0xd61f4faa13a11aa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11aae expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972698.874524:0:24143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd200/0xd61f4faa13a11aa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11aae expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972698.874533:0:24143:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff888d05dff000 from 1 10000000:01000000:3.0:1790972698.874536:0:24143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790972698.874573:0:24143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972698.874580:0:24143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972698.874590:0:24143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972698.874614:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790972698.874702:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.874730:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397662336 00000100:00100000:3.0:1790972698.874736:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d07bb8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790972698.874738:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397662336 00000100:00100000:2.0:1790972698.874790:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790972698.874807:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:24143:x1877970397662336:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790972698.874821:0:22637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972698.874832:0:22637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3d3cc800/0xd61f4faa13a11aca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11ac3 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.874853:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3d3cc800/0xd61f4faa13a11aca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11ac3 expref: 20 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.874935:0:22637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3d3cc800/0xd61f4faa13a11aca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11ac3 expref: 20 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.874945:0:22637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3d3cc800, rc 0) 00000100:00100000:2.0:1790972698.875067:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:24143:x1877970397662336:12345-0@lo:101:mount.lustre.0 Request processed in 269us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972698.875073:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790972698.875121:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790972698.875135:0:24143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11aca expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972698.875158:0:24143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11aca expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790972698.883573:0:24143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1790972698.883903:0:24143:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790972698.884462:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1790972698.884493:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1790972698.884508:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1790972698.884523:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1790972698.884537:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1790972698.884564:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1790972698.884576:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1790972698.884587:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1790972698.884600:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1790972698.884629:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1790972698.884645:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1790972698.884766:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1790972698.884775:0:24143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1790972698.884858:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972698.884925:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.885000:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3600 going to sleep for 11 seconds 00000100:00100000:1.0:1790972698.886302:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397662464 00000100:00100000:1.0:1790972698.886321:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397662464 00000100:00100000:1.0:1790972698.886371:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790972698.886381:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:24143:x1877970397662464:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790972698.886530:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:24143:x1877970397662464:12345-0@lo:501:mount.lustre.0 Request processed in 150us (1605us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972698.886538:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790972698.886686:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662464:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972698.886728:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662592:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790972698.886772:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.886801:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3600 going to sleep for 11 seconds 00000100:00100000:3.0:1790972698.886874:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397662592 00000100:00100000:3.0:1790972698.886879:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397662592 00000100:00100000:3.0:1790972698.886914:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1790972698.886922:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:24143:x1877970397662592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790972698.887003:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:24143:x1877970397662592:12345-0@lo:503:mount.lustre.0 Request processed in 81us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972698.887010:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790972698.887103:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662592:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790972698.887487:0:24143:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790972698.887549:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972698.887588:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.887619:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3600 going to sleep for 11 seconds 00000100:00100000:3.0:1790972698.887760:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397662720 00000100:00100000:3.0:1790972698.887765:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397662720 00000100:00100000:3.0:1790972698.887789:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790972698.887797:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:24143:x1877970397662720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790972698.887876:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:24143:x1877970397662720:12345-0@lo:502:mount.lustre.0 Request processed in 79us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972698.887883:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790972698.887970:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972698.888217:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790972698.888255:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1790972698.888271:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1790972698.888282:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1790972698.888294:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1790972698.888305:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1790972698.888328:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1790972698.888341:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1790972698.888353:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1790972698.888365:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1790972698.888396:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1790972698.888420:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972698.888459:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.888600:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3600 going to sleep for 11 seconds 00000100:00100000:3.0:1790972698.889474:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397662848 00000100:00100000:3.0:1790972698.889482:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397662848 00000100:00100000:3.0:1790972698.889570:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790972698.889578:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:24143:x1877970397662848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790972698.889726:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:24143:x1877970397662848:12345-0@lo:502:mount.lustre.0 Request processed in 149us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972698.889733:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790972698.889821:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972698.889887:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1790972698.889899:0:24143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1790972698.890582:0:24164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790972698.890591:0:24164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972698.890593:0:24164:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1790972698.890601:0:24164:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff888d05dff000 00000020:00000080:2.0:1790972698.890603:0:24164:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790972698.890610:0:24164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790972698.890613:0:24164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972698.890614:0:24164:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1790972698.890616:0:24164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790972698.890618:0:24164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972698.890619:0:24164:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790972698.890622:0:24164:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff888d05dff000 00000020:00000080:2.0:1790972698.890624:0:24164:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790972698.890695:0:24164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790972698.890699:0:24164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972698.890701:0:24164:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1790972698.890703:0:24164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790972698.890706:0:24164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972698.890707:0:24164:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790972698.890710:0:24164:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff888d05dff000 00000020:00000080:2.0:1790972698.890720:0:24164:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790972698.890739:0:24164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790972698.890743:0:24164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972698.890744:0:24164:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1790972698.890747:0:24164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790972698.890749:0:24164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972698.890750:0:24164:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1790972698.890753:0:24164:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff888d05dff000 00000020:00000080:2.0:1790972698.890755:0:24164:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1790972698.890775:0:24164:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790972698.890778:0:24164:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790972698.890780:0:24164:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1790972698.890782:0:24164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:1.0:1790972698.893743:0:24143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1790972698.893791:0:24143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790972698.893808:0:24143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11aca expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.893821:0:24143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11aca expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790972698.893879:0:24143:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1790972698.893882:0:24143:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff888d05dff000 10000000:01000000:1.0:1790972698.893885:0:24143:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff888d05dff000 10000000:01000000:1.0:1790972698.893889:0:24143:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790972698.893894:0:24143:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff888d05dff000 from 1 10000000:01000000:1.0:1790972698.893896:0:24143:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1790972698.893930:0:24143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.893940:0:24143:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.893950:0:24143:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972698.893973:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05488e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662976:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790972698.894041:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972698.894405:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e15dceb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790972698.895610:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397662976 00000100:00100000:0.0:1790972698.895620:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397662976 00000100:00100000:0.0:1790972698.895684:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1790972698.895693:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:24143:x1877970397662976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790972698.895710:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790972698.895728:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e15085400/0xd61f4faa13a11ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11ad1 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972698.895764:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e15085400/0xd61f4faa13a11ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11ad1 expref: 21 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972698.895774:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e15085400/0xd61f4faa13a11ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11ad1 expref: 21 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972698.895783:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e15085400, rc 0) 00000100:00100000:0.0:1790972698.895852:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397662976:12345-0@lo:101:mount.lustre.0 Request processed in 160us (1810us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972698.895858:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790972698.897278:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05488e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397662976:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790972698.897303:0:24143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11ad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11ad8 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.897314:0:24143:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11ad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11ad8 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790972698.907150:0:24143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1790972698.907460:0:24143:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790972698.907636:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1790972698.907692:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1790972698.907713:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1790972698.907728:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1790972698.907743:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1790972698.907757:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1790972698.907770:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1790972698.907782:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1790972698.907793:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1790972698.907806:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1790972698.907820:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1790972698.907832:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1790972698.907862:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1790972698.907880:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1790972698.907893:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1790972698.907907:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1790972698.907919:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1790972698.907931:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1790972698.907955:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1790972698.907970:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1790972698.907983:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1790972698.907997:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1790972698.908011:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1790972698.908023:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1790972698.908034:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1790972698.908044:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1790972698.908056:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1790972698.908066:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1790972698.908365:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1790972698.908383:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1790972698.908396:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1790972698.908408:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1790972698.908420:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1790972698.908433:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1790972698.908445:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1790972698.908457:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1790972698.908470:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1790972698.908482:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1790972698.908496:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1790972698.908509:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1790972698.908522:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1790972698.908535:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1790972698.908547:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1790972698.908560:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1790972698.908585:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1790972698.908599:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1790972698.908613:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1790972698.908627:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1790972698.909318:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1790972698.909348:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1790972698.909369:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1790972698.909381:0:24143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1790972698.909589:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397663104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972698.909651:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972698.913994:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397663104 00000100:00100000:0.0:1790972698.914008:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397663104 00000100:00100000:0.0:1790972698.914066:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1790972698.914076:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397663104:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790972698.914382:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397663104:12345-0@lo:501:mount.lustre.0 Request processed in 307us (4730us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972698.914390:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790972698.914553:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3540 going to sleep for 11 seconds 00000100:00100000:2.0:1790972698.914578:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397663104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972698.914627:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397663232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790972698.914967:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.914989:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3540 going to sleep for 11 seconds 00000100:00100000:2.0:1790972698.915003:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397663232 00000100:00100000:2.0:1790972698.915008:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397663232 00000100:00100000:2.0:1790972698.915037:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790972698.915042:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397663232:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790972698.915125:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397663232:12345-0@lo:503:mount.lustre.0 Request processed in 82us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972698.915132:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790972698.915301:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397663232:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790972698.915996:0:24143:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790972698.916069:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397663360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972698.916121:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972698.916247:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397663360 00000100:00100000:0.0:1790972698.916252:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397663360 00000100:00100000:0.0:1790972698.916289:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790972698.916297:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397663360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972698.916306:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1790972698.916398:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397663360:12345-0@lo:502:mount.lustre.0 Request processed in 102us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972698.916406:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790972698.916490:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397663360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972698.916631:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1790972698.916649:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1790972698.916657:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1790972698.916698:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1790972698.916723:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1790972698.916737:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1790972698.916768:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1790972698.916791:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1790972698.916807:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1790972698.916821:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1790972698.916834:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1790972698.916847:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1790972698.916860:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1790972698.916873:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1790972698.916885:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1790972698.916897:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1790972698.916909:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1790972698.916921:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1790972698.916934:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1790972698.916946:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1790972698.916957:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1790972698.916969:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1790972698.916997:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1790972698.917014:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1790972698.917028:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1790972698.917041:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1790972698.917054:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1790972698.917068:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1790972698.917079:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1790972698.917207:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1790972698.917221:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1790972698.917234:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1790972698.917247:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1790972698.917261:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1790972698.917274:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1790972698.917288:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1790972698.917300:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1790972698.917325:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1790972698.917349:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1790972698.917363:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1790972698.917374:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1790972698.917385:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1790972698.917397:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1790972698.917409:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1790972698.917423:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1790972698.917435:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1790972698.917448:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1790972698.917460:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1790972698.917501:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397663488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972698.917555:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.917596:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3540 going to sleep for 11 seconds 00000100:00100000:3.0:1790972698.917657:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397663488 00000100:00100000:3.0:1790972698.917697:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397663488 00000100:00100000:3.0:1790972698.917737:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1790972698.917746:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397663488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790972698.917969:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397663488:12345-0@lo:502:mount.lustre.0 Request processed in 224us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972698.917976:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1790972698.918043:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397663488:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790972698.918333:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1790972698.918357:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1790972698.918380:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397663616:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790972698.918417:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972698.918484:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06baa780 going to sleep for 11 seconds 00000100:00100000:3.0:1790972698.918531:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397663616 00000100:00100000:3.0:1790972698.918535:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397663616 00000100:00100000:3.0:1790972698.918593:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1790972698.918601:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397663616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790972698.918700:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397663616:12345-0@lo:502:mount.lustre.0 Request processed in 99us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972698.918707:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790972698.918772:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397663616:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790972698.918809:0:24143:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1790972698.918817:0:24143:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1790972698.921777:0:24169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790972698.921795:0:24169:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff888d06958000) 00000020:00000080:3.0:1790972698.921910:0:24169:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1790972698.922007:0:24169:0:(tgt_mount.c:153:server_get_mount()) get mount ffff888d05dff000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790972698.922011:0:24169:0:(tgt_mount.c:187:server_put_mount()) put mount ffff888d05dff000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790972698.922014:0:24169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888d05dff000 3 00010000:00080000:3.0:1790972698.922044:0:24169:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888d07eb4000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1790972698.924422:0:24169:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1790972698.924851:0:24169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1790972698.924896:0:24169:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790972698.924908:0:24169:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd61f4faa13a11ae6 00000100:00080000:3.0:1790972698.924918:0:24169:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790972698.924928:0:24169:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff888d07eb4000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1790972698.924962:0:24169:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3a7d3800 x1877970397663744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790972698.924992:0:24169:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1790972698.925047:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972698.925051:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790972698.925054:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972698.925056:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790972698.925065:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877970397663744:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1790972698.925080:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972698.925083:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790972698.925086:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972698.925089:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790972698.925115:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397663872:0@lo:400:kworker.0 00000100:00100000:2.0:1790972698.925139:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972698.925154:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.925269:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877970397664000:0@lo:400:kworker.0 00000100:00100000:2.0:1790972698.925295:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.925316:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790972698.925321:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397664128:0@lo:400:kworker.0 00000100:00100000:2.0:1790972698.925342:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.925375:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397663744 00000100:00100000:0.0:1790972698.925423:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790972698.925430:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877970397664256:0@lo:400:kworker.0 00000100:00100000:0.0:1790972698.925456:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972698.925647:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397664000 00000100:00100000:1.0:1790972698.925655:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397664000 00000100:00100000:1.0:1790972698.925766:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397664256 00000100:00100000:1.0:1790972698.925769:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397664256 00000100:00100000:1.0:1790972698.925783:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790972698.925790:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877970397664000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972698.925844:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d523480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877970397664000:12345-0@lo:400:kworker.0 Request processed in 54us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972698.925851:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790972698.925955:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790972698.925963:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877970397664256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972698.926009:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877970397664256:12345-0@lo:400:kworker.0 Request processed in 47us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972698.926015:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1790972698.926053:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff888e3d5bd180 x1877970397664256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972698.926066:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877970397664256:0@lo:400:kworker.0 00000100:00100000:2.0:1790972698.927209:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397663744 00000100:00100000:2.0:1790972698.927254:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790972698.927261:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877970397663744:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790972698.927286:0:22642:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:2.0:1790972698.927331:0:22642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd61f4faa13a11aed 00000004:00100000:2.0:1790972698.927348:0:22642:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790972698.927389:0:22642:0:(import.c:65:import_set_state_nolock()) ffff888e3fa29000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790972698.927447:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d521c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1877970397663744:12345-0@lo:38:llog_process_th.0 Request processed in 185us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972698.927454:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790972698.927480:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397663872 00000100:00100000:2.0:1790972698.927483:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397663872 00000100:00100000:2.0:1790972698.927515:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397664128 00000100:00100000:2.0:1790972698.927518:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397664128 00000100:00100000:2.0:1790972698.927530:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790972698.927535:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397663872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972698.927576:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397663872:12345-0@lo:400:kworker.0 Request processed in 40us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972698.927582:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790972698.927593:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790972698.927598:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397664128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972698.927625:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d522680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397664128:12345-0@lo:400:kworker.0 Request processed in 27us (2282us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972698.927632:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1790972698.927710:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff888e3a7d3800 x1877970397663744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790972708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972698.927722:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790972698.927728:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1790972698.927735:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790972698.927739:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790972698.927741:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d07eb4000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790972698.927747:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3637:1877970397663744:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790972698.927792:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397663872:0@lo:400:kworker.0 00000100:00100000:2.0:1790972698.927820:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397664128:0@lo:400:kworker.0 00010000:00080000:2.0:1790972698.927831:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff888e3d5bd500 x1877970397664000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972698.927840:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877970397664000:0@lo:400:kworker.0 00000020:01000004:3.0:1790972698.928302:0:24169:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790972698.928319:0:24169:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff888e3d81b380) 00000020:00000080:3.0:1790972698.928337:0:24169:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1790972698.928419:0:24169:0:(tgt_mount.c:153:server_get_mount()) get mount ffff888d05dff000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790972698.928423:0:24169:0:(tgt_mount.c:187:server_put_mount()) put mount ffff888d05dff000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790972698.928429:0:24169:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888d05dff000 3 00010000:00080000:3.0:1790972698.928459:0:24169:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888d07eb6000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.139@tcp at head 00010000:00010000:3.0:1790972698.934327:0:24169:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1790972698.934504:0:24169:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1790972698.934544:0:24169:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790972698.934557:0:24169:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd61f4faa13a11afb 00000100:00080000:3.0:1790972698.934567:0:24169:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790972698.934577:0:24169:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff888d07eb6000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1790972698.934610:0:24169:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3a7d1c00 x1877970397664384/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790972698.934691:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1877970397664384:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790972698.934758:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790972698.934833:0:24169:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1790972698.934855:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972698.934860:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790972698.934862:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972698.934865:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790972698.934869:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972698.934872:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790972698.934874:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972698.934884:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790972698.941794:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397664384 00000100:00100000:1.0:1790972698.941809:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397664384 00000100:00100000:1.0:1790972698.941857:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790972698.941866:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3637:x1877970397664384:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1790972698.941900:0:23867:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 636 last 0 00000020:00000080:1.0:1790972698.941935:0:23867:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd61f4faa13a11b02 00000004:00100000:1.0:1790972698.941953:0:23867:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790972698.941984:0:23867:0:(import.c:65:import_set_state_nolock()) ffff888e3f737800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790972698.943505:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d520380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1877970397664384:12345-0@lo:38:llog_process_th.0 Request processed in 1632us (8739us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972698.943525:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790972698.943619:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff888e3a7d1c00 x1877970397664384/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790972708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972698.943632:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790972698.943642:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:2.0:1790972698.943649:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790972698.943654:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1790972698.943657:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d07eb6000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790972698.943683:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3637:1877970397664384:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1790972698.944026:0:24169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1790972698.944105:0:24143:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1790972698.944133:0:24143:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790972698.944147:0:24143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11ad1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11ad8 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.944157:0:24143:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e09febe00/0xd61f4faa13a11ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11ad8 expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1790972698.944235:0:24143:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1790972698.944237:0:24143:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790972698.944238:0:24143:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972698.944239:0:24143:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972698.944241:0:24143:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972698.944242:0:24143:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972698.944244:0:24143:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790972698.944246:0:24143:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972698.944247:0:24143:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790972698.944251:0:24143:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1790972698.944254:0:24143:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790972698.944255:0:24143:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790972698.944256:0:24143:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972698.944257:0:24143:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972698.944258:0:24143:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972698.944259:0:24143:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972698.944260:0:24143:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790972698.944261:0:24143:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972698.944262:0:24143:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1790972698.944282:0:24143:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790972698.944298:0:24143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d523800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397664512:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790972698.944356:0:24143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972698.944400:0:24143:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1790972698.944514:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397664512 00000100:00100000:0.0:1790972698.944532:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397664512 00000100:00100000:0.0:1790972698.944571:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1790972698.944580:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397664512:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790972698.944606:0:22637:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790972698.944620:0:22637:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790972698.954384:0:22637:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790972698.954406:0:22637:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1790972698.954425:0:22658:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790972698.954429:0:22658:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790972698.954452:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.954470:0:22658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e3ad42600/0xd61f4faa13a11a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a4c expref: 21 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.954477:0:22658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11a61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a5a expref: 21 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.954484:0:22658:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.954522:0:22658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11a5a expref: 21 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.954539:0:22658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11a61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11a5a expref: 21 pid: 22637 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972698.954553:0:22658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05488e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397664640:0@lo:104: 00000100:00100000:3.0:1790972698.954891:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24143:x1877970397664512:12345-0@lo:253:mount.lustre.0 Request processed in 10309us (10532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972698.954902:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1790972698.954921:0:24143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d523800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24143:1877970397664512:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790972698.954934:0:24143:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1790972698.954937:0:24143:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790972698.954939:0:24143:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790972698.954940:0:24143:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790972698.954941:0:24143:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790972698.954942:0:24143:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790972698.954944:0:24143:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790972698.954946:0:24143:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790972698.954948:0:24143:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790972698.954949:0:24143:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1790972698.954964:0:24143:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790972698.955873:0:22658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790972698.955975:0:22658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e3ad42600/0xd61f4faa13a11a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11a4c expref: 20 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.955987:0:22658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e3ad42600/0xd61f4faa13a11a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11a4c expref: 20 pid: 22637 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972698.955998:0:22658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05489180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397664768:0@lo:104: 00000100:00100000:1.0:1790972698.956043:0:22658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972698.956313:0:22658:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e15dce3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972698.956514:0:22625:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790972698.956546:0:22625:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397664640 00000100:00100000:3.0:1790972698.956554:0:22625:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397664640 00000100:00100000:3.0:1790972698.956582:0:22625:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397664768 00000100:00100000:3.0:1790972698.956585:0:22625:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397664768 00000100:00100000:3.0:1790972698.956598:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790972698.956605:0:22625:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+4:22658:x1877970397664640:12345-0@lo:104: 00010000:00010000:3.0:1790972698.956617:0:22625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11a61 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972698.956772:0:22658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05488e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397664640:0@lo:104: 00010000:00010000:3.0:1790972698.956956:0:22625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790972698.956972:0:22625:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05489880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+4:22658:x1877970397664640:12345-0@lo:104: Request processed in 359us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972698.956979:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790972698.956997:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790972698.957004:0:22625:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e2d34d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+3:22658:x1877970397664768:12345-0@lo:104: 00010000:00010000:3.0:1790972698.957012:0:22625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11a53 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957343:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790972698.957350:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11a61 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957357:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3d3cc200 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:1.0:1790972698.957361:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a11a61 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957370:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a11a61 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790972698.957376:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a11a61 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790972698.957382:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000001:00000004:2.0:1790972698.957408:0:24143:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:1.0:1790972698.957421:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a61 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957426:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790972698.957448:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a61 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957455:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc200/0xd61f4faa13a11a5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a61 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957468:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790972698.957471:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11a53 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957483:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3d3cc400 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:1.0:1790972698.957486:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a11a53 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957493:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a11a53 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790972698.957499:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a11a53 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790972698.957505:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1790972698.957528:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a53 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957533:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790972698.957546:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a53 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957553:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc400/0xd61f4faa13a11a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a53 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957566:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972698.957567:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972698.957569:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790972698.957576:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790972698.957588:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397664896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790972698.957618:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972698.957657:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397664896 00000100:00100000:1.0:1790972698.957688:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397664896 00010000:00010000:1.0:1790972698.957715:0:22629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11a61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11a5a expref: 21 pid: 22637 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972698.957729:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3638:1877970397665024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790972698.957753:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790972698.957759:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972698.957760:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:3640:x1877970397664896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790972698.957770:0:22629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790972698.957775:0:22629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11a61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11a5a expref: 21 pid: 22637 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957786:0:22629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11a61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11a5a expref: 21 pid: 22637 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972698.957792:0:23795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397665024 00010000:00010000:1.0:1790972698.957799:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11a61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11a5a expref: 21 pid: 22637 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.957812:0:22629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790972698.957843:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:3640:x1877970397664896:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972698.957849:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790972698.957885:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397664896:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790972698.957914:0:22658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05489180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397664768:0@lo:104: 00010000:00010000:1.0:1790972698.957932:0:22658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972698.958030:0:23795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397665024 00010000:00010000:2.0:1790972698.958050:0:23795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e3ad42600/0xd61f4faa13a11a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11a4c expref: 20 pid: 22637 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972698.958077:0:23795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790972698.958084:0:23795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07dfe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:3638:x1877970397665024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790972698.958091:0:23795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790972698.958095:0:23795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e3ad42600/0xd61f4faa13a11a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11a4c expref: 20 pid: 22637 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.958104:0:23795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e3ad42600/0xd61f4faa13a11a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11a4c expref: 20 pid: 22637 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.958115:0:23795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3ad42600/0xd61f4faa13a11a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11a4c expref: 20 pid: 22637 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.958124:0:23795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.958132:0:23795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1790972698.958147:0:23795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005897832s 00010000:00010000:2.0:1790972698.958152:0:23795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.958179:0:23795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.958185:0:23795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.958191:0:23795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.958197:0:23795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e09fea200 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972698.958201:0:23795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.958209:0:23795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972698.958487:0:22625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1790972698.958497:0:22625:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e2d34d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+3:22658:x1877970397664768:12345-0@lo:104: Request processed in 1492us (2451us total) trans 0 rc 0/0 00010000:00010000:0.0:1790972698.958500:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972698.958514:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00080000:3.0:1790972698.961812:0:24143:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1790972698.961821:0:24143:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1790972698.961856:0:24143:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790972698.961894:0:24143:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790972698.961940:0:24143:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1790972698.962087:0:24143:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1790972698.963784:0:24143:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790972698.964229:0:24143:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1790972698.967763:0:22658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972698.967777:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.968053:0:23795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.968065:0:23795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e09fea200/0xd61f4faa13a11b09 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972698.968087:0:23795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790972698.970906:0:23795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07dfe450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:3638:x1877970397665024:12345-0@lo:103:ldlm_bl.0 Request processed in 12814us (13137us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972698.970923:0:23795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790972698.973372:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05489f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3638:1877970397665024:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972699.189513:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1790972699.850469:0:24222:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790972699.850717:0:24222:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1790972699.893573:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397665152:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790972699.893655:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972699.894220:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790972699.894231:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397665280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790972699.894266:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972699.894291:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397665152 00000100:00100000:3.0:1790972699.894299:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397665152 00000100:00100000:3.0:1790972699.894354:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790972699.894364:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397665152:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790972699.894398:0:23382:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790972699.894455:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d523800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397665152:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972699.894463:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790972699.894498:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397665152:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790972699.894595:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397665280 00000100:00100000:3.0:1790972699.894600:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397665280 00000100:00100000:3.0:1790972699.894628:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790972699.894635:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397665280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790972699.894654:0:22647:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790972699.897637:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d521f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397665280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2993us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972699.897688:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790972699.897817:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397665280:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1790972700.212906:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790972700.533767:0:22676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1790972700.731919:0:22639:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790972700.731926:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff888e02880000 from 13 10000000:01000000:2.0:1790972700.731931:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790972700.731977:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972700.731989:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972700.732000:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972700.732025:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397665408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790972700.732105:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972700.732142:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e103c76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972700.734556:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397665408 00000100:00100000:3.0:1790972700.734570:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397665408 00000100:00100000:3.0:1790972700.734647:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790972700.734656:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+19:22639:x1877970397665408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790972700.734693:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972700.734714:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3ad42a00/0xd61f4faa13a11b17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11b10 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972700.734752:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3ad42a00/0xd61f4faa13a11b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11b10 expref: 20 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972700.734763:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3ad42a00/0xd61f4faa13a11b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11b10 expref: 20 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972700.734771:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad42a00, rc 0) 00000100:00100000:3.0:1790972700.734847:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:22639:x1877970397665408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (2742us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972700.734853:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1790972700.735027:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397665408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790972700.735046:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11b17 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972700.735056:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11b17 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972700.735206:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397665536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1790972700.735245:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972700.735280:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e103c76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790972700.735400:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397665536 00000100:00100000:1.0:1790972700.735405:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397665536 00000100:00100000:1.0:1790972700.735519:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1790972700.735528:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:22639:x1877970397665536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790972700.735544:0:22636:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790972700.735558:0:22636:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790972700.735561:0:22636:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1790972700.735635:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:22639:x1877970397665536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972700.735643:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790972700.735925:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397665536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1790972700.735987:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1790972700.735995:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11b17 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972700.736004:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11b17 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972700.736013:0:22639:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1790972700.736015:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff888e2d3c6000 from 13 10000000:01000000:2.0:1790972700.736018:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1790972700.736039:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972700.736047:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972700.736055:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972700.736550:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397665664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790972700.736591:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972700.736625:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e103c76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790972700.737903:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397665664 00000100:00100000:0.0:1790972700.737915:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397665664 00000100:00100000:0.0:1790972700.737970:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790972700.737979:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:22639:x1877970397665664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790972700.737994:0:22636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790972700.738009:0:22636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11b25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11b1e expref: -99 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972700.738034:0:22636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11b1e expref: 21 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972700.738055:0:22636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11b1e expref: 21 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972700.738063:0:22636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e15085e00, rc 0) 00000100:00100000:0.0:1790972700.738139:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:22639:x1877970397665664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972700.738146:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790972700.738346:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397665664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790972700.738364:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11b25 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972700.738373:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11b25 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972700.738433:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05489180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397665792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790972700.738471:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972700.738506:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e15dce3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972700.738549:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397665792 00000100:00100000:3.0:1790972700.738554:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397665792 00000100:00100000:3.0:1790972700.738589:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790972700.738597:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:22639:x1877970397665792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790972700.738611:0:22637:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790972700.738627:0:22637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790972700.738631:0:22637:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1790972700.738738:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:22639:x1877970397665792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 142us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972700.738821:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1790972700.738940:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05489180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397665792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790972700.738997:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790972700.739004:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11b25 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972700.739023:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11b25 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972701.236803:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972702.263566:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972703.286694:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790972703.989810:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972703.989817:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790972703.989820:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972703.989823:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790972703.989840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972703.989851:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790972703.989854:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972703.989857:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790972703.989927:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397665920:0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.989996:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972703.990035:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877970397666432:0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990062:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972703.990090:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790972703.990096:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397666304:0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990122:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972703.990164:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397666048:0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990189:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972703.990217:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877970397666560:0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990239:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972703.990257:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790972703.990262:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877970397666176:0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990282:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972703.990297:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877970397666688:0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990314:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972703.990340:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397665920 00000100:00100000:2.0:1790972703.990347:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397665920 00000100:00100000:2.0:1790972703.990391:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790972703.990400:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:3641:x1877970397665920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990449:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:3641:x1877970397665920:12345-0@lo:400:kworker.0 Request processed in 50us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972703.990464:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1790972703.990496:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397666432 00000100:00100000:2.0:1790972703.990500:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397666432 00000100:00100000:2.0:1790972703.990518:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397666560 00000100:00100000:2.0:1790972703.990521:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397666560 00000100:00100000:2.0:1790972703.990549:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397666176 00000100:00100000:2.0:1790972703.990552:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397666176 00000100:00100000:2.0:1790972703.990562:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397666688 00000100:00100000:2.0:1790972703.990564:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397666688 00000100:00100000:2.0:1790972703.990577:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790972703.990582:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877970397666432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990613:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877970397666432:12345-0@lo:400:kworker.0 Request processed in 32us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972703.990619:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790972703.990631:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790972703.990637:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877970397666560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990692:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877970397666560:12345-0@lo:400:kworker.0 Request processed in 55us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972703.990698:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790972703.990710:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790972703.990716:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877970397666176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990742:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877970397666176:12345-0@lo:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972703.990748:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790972703.990759:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790972703.990764:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877970397666688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990803:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877970397666688:12345-0@lo:400:kworker.0 Request processed in 38us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972703.990809:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790972703.990827:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397666304 00000100:00100000:2.0:1790972703.990830:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397666304 00000100:00100000:2.0:1790972703.990851:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397666048 00000100:00100000:2.0:1790972703.990854:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397666048 00000100:00100000:2.0:1790972703.990865:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790972703.990870:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397666304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990901:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397666304:12345-0@lo:400:kworker.0 Request processed in 30us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972703.990906:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790972703.990916:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790972703.990921:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397666048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.990947:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397666048:12345-0@lo:400:kworker.0 Request processed in 26us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972703.990952:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790972703.990992:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397666304:0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.991002:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397665920:0@lo:400:kworker.0 00010000:00080000:2.0:1790972703.991013:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3f74d500 x1877970397666432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972703.991023:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877970397666432:0@lo:400:kworker.0 00010000:00080000:2.0:1790972703.991053:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3f74e680 x1877970397666176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972703.991063:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877970397666176:0@lo:400:kworker.0 00010000:00080000:2.0:1790972703.991082:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3f74ce00 x1877970397666688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972703.991091:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877970397666688:0@lo:400:kworker.0 00000100:00100000:2.0:1790972703.991100:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d520000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397666048:0@lo:400:kworker.0 00010000:00080000:2.0:1790972703.991107:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3f74fb80 x1877970397666560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972703.991113:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877970397666560:0@lo:400:kworker.0 00000100:00080000:1.0:1790972703.991251:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790972703.991256:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790972704.311101:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972705.013853:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397666944:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790972705.013924:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972705.013964:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790972705.013971:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397666816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790972705.013993:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972705.014025:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397666944 00000100:00100000:3.0:1790972705.014031:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397666944 00000100:00100000:3.0:1790972705.014068:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397666816 00000100:00100000:3.0:1790972705.014071:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397666816 00000100:00100000:3.0:1790972705.014084:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790972705.014090:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397666944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790972705.014137:0:23382:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790972705.014180:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397666944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972705.014187:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790972705.014204:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790972705.014210:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397666816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790972705.014226:0:23382:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790972705.014251:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397666816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 41us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972705.014256:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790972705.014652:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397666816:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790972705.014684:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397666944:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1790972705.130504:0:24512:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790972705.333868:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790972706.064281:0:24565:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790972706.064488:0:24565:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790972706.356999:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790972706.943573:0:23395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1790972707.041187:0:24615:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790972707.041449:0:24615:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1790972707.391628:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972708.405526:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790972709.108936:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972709.108942:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790972709.108945:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972709.108949:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790972709.108971:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972709.108974:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790972709.108977:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790972709.108981:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1790972709.109034:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3638:1877970397667072:0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.109128:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972709.109172:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877970397667584:0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.109199:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972709.109224:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1790972709.109230:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397667200:0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.109254:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972709.109273:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877970397667712:0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.109293:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972709.109320:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397667456:0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.109342:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972709.109361:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790972709.109367:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877970397667328:0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.109387:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972709.109413:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877970397667840:0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.109433:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972709.109461:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397667584 00000100:00100000:2.0:1790972709.109469:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397667584 00000100:00100000:2.0:1790972709.109505:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397667712 00000100:00100000:2.0:1790972709.109509:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397667712 00000100:00100000:2.0:1790972709.109531:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397667328 00000100:00100000:2.0:1790972709.109534:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397667328 00000100:00100000:2.0:1790972709.109545:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397667840 00000100:00100000:2.0:1790972709.109548:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397667840 00000100:00100000:2.0:1790972709.109563:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790972709.109571:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877970397667584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.109624:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877970397667584:12345-0@lo:400:kworker.0 Request processed in 54us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972709.109642:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790972709.109810:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397667072 00000100:00100000:0.0:1790972709.109815:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397667072 00000100:00100000:0.0:1790972709.109846:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1790972709.109853:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:3638:x1877970397667072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972709.109889:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:3638:x1877970397667072:12345-0@lo:400:kworker.0 Request processed in 37us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972709.109895:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1790972709.110058:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790972709.110068:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877970397667712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.110110:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877970397667712:12345-0@lo:400:kworker.0 Request processed in 44us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972709.110116:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790972709.110129:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790972709.110134:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877970397667328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.110173:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877970397667328:12345-0@lo:400:kworker.0 Request processed in 38us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972709.110178:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790972709.110188:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790972709.110193:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877970397667840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.110217:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d520000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3641:x1877970397667840:12345-0@lo:400:kworker.0 Request processed in 25us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972709.110223:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790972709.110240:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397667200 00000100:00100000:2.0:1790972709.110244:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397667200 00000100:00100000:2.0:1790972709.110268:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397667456 00000100:00100000:2.0:1790972709.110271:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397667456 00000100:00100000:2.0:1790972709.110283:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790972709.110290:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397667200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.110321:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397667200:12345-0@lo:400:kworker.0 Request processed in 32us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972709.110327:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790972709.110347:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790972709.110352:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397667456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.110380:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397667456:12345-0@lo:400:kworker.0 Request processed in 28us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972709.110386:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790972709.110426:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397667200:0@lo:400:kworker.0 00010000:00080000:2.0:1790972709.110439:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3f74f800 x1877970397667712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972709.110449:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877970397667712:0@lo:400:kworker.0 00000100:00100000:2.0:1790972709.110456:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3638:1877970397667072:0@lo:400:kworker.0 00010000:00080000:2.0:1790972709.110465:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3f74ed80 x1877970397667584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972709.110473:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877970397667584:0@lo:400:kworker.0 00010000:00080000:0.0:1790972709.110709:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3f74e680 x1877970397667328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972709.110719:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877970397667328:0@lo:400:kworker.0 00010000:00080000:0.0:1790972709.110732:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3f74df80 x1877970397667840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972709.110739:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3641:1877970397667840:0@lo:400:kworker.0 00000100:00100000:0.0:1790972709.110747:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397667456:0@lo:400:kworker.0 00000100:00080000:1.0:1790972709.112030:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790972709.112036:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790972709.172755:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972694/real 1790972694] req@ffff888e3a7d0700 x1877970397660928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972709 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972709.172789:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e3a7d0700 x1877970397660928/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972709 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972709.172799:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972694/real 1790972694] req@ffff888e3a7d1f80 x1877970397661056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972709 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972709.172810:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e3a7d1f80 x1877970397661056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972709 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790972709.172830:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e20346800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790972709.172871:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790972709.172875:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397660928:0@lo:8:kworker.0 00000100:00080000:1.0:1790972709.172881:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d05dfd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790972709.172885:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790972709.172888:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397661056:0@lo:8:kworker.0 00000100:00080000:0.0:1790972709.172930:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972709.172936:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790972709.172939:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972709.172942:0:471:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790972709.172946:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972709.172949:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1790972709.172952:0:471:0:(import.c:65:import_set_state_nolock()) ffff888e20346800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972709.172957:0:471:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 632 00000100:00080000:0.0:1790972709.172966:0:471:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790972709.172977:0:471:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff888e20346800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972709.173014:0:471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3d5bd180 x1877970397667968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1790972709.173036:0:471:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972709.173039:0:471:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790972709.173041:0:471:0:(import.c:65:import_set_state_nolock()) ffff888d05dfd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972709.173043:0:471:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 632 00000100:00080000:0.0:1790972709.173046:0:471:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1790972709.173050:0:471:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff888d05dfd000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972709.173062:0:471:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3d5bc000 x1877970397668096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790972709.173108:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397667968:0@lo:8:kworker.0 00000100:00100000:1.0:1790972709.173249:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972709.173317:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397668096:0@lo:8:kworker.0 00000100:00100000:2.0:1790972709.173448:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397667968 00000100:00100000:2.0:1790972709.173456:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397667968 00000100:00100000:2.0:1790972709.173496:0:24147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790972709.173513:0:24147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877970397667968:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790972709.173544:0:24147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:2.0:1790972709.173578:0:24147:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd61f4faa13a11b2c 00002000:00100000:2.0:1790972709.173592:0:24147:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff888e3fa2a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1790972709.173597:0:24147:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1790972709.173600:0:24147:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790972709.173830:0:24147:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00100000:1.0:1790972709.173942:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972709.174087:0:24150:0:(service.c:3485:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1790972709.174113:0:24150:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1790972709.175319:0:24147:0:(import.c:65:import_set_state_nolock()) ffff888e3fa2a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790972709.175442:0:24147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05489180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3637:x1877970397667968:12345-0@lo:8:kworker.0 Request processed in 1935us (2190us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972709.175453:0:24147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790972709.175483:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397668096 00000100:00100000:2.0:1790972709.175490:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397668096 00000100:00100000:2.0:1790972709.175527:0:24147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790972709.175533:0:24147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877970397668096:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790972709.175554:0:24147:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790972709.175589:0:24147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05488e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877970397668096:12345-0@lo:8:kworker.0 Request processed in 52us (1644us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790972709.175594:0:24147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790972709.179507:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3d5bd180 x1877970397667968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790972729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972709.179524:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790972709.179535:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1790972709.179543:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790972709.179550:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790972709.179553:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e20346800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790972709.179593:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790972709.179600:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397667968:0@lo:8:kworker.0 00000100:00080000:1.0:1790972709.179615:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d05dfd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790972709.179620:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790972709.179623:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397668096:0@lo:8:kworker.0 00000004:00080000:3.0:1790972709.179779:0:23383:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790972709.179887:0:23383:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 647207224740ns, next at 0ns, rc = 0 00080000:00080000:3.0:1790972709.179894:0:23383:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1790972709.180225:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397668224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1790972709.180299:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1790972709.180302:0:23384:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:2.0:1790972709.180342:0:23384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23384:1877970397668352:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1790972709.180378:0:23384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972709.180402:0:23384:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06adce40 going to sleep for 11 seconds 00000100:00100000:3.0:1790972709.180523:0:24151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397668224 00000100:00100000:3.0:1790972709.180531:0:24151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397668224 00000100:00100000:0.0:1790972709.180618:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397668352 00000100:00100000:3.0:1790972709.180628:0:24151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790972709.180630:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397668352 00000100:00100000:3.0:1790972709.180639:0:24151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1877970397668224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790972709.180693:0:24151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790972709.180745:0:24151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3641:x1877970397668224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 109us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972709.180752:0:24151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790972709.180779:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790972709.180787:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23384:x1877970397668352:12345-0@lo:7:osp-pre-0-1.0 00010000:00080000:3.0:1790972709.181002:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3d521500 x1877970397668224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790972725 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972709.181017:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397668224:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1790972709.182196:0:23374:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:1.0:1790972709.187278:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1790972709.189023:0:24149:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1790972709.189034:0:24149:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1790972709.189138:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23384:x1877970397668352:12345-0@lo:7:osp-pre-0-1.0 Request processed in 8347us (8755us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972709.189150:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790972709.189364:0:23384:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3f74d500 x1877970397668352/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790972725 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972709.189380:0:23384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23384:1877970397668352:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1790972709.189394:0:23384:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:0.0:1790972709.189434:0:23384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23384:1877970397668480:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1790972709.189473:0:23384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972709.189505:0:23384:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06adce40 going to sleep for 11 seconds 00000100:00100000:1.0:1790972709.189588:0:24150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397668480 00000100:00100000:1.0:1790972709.189597:0:24150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397668480 00000100:00100000:1.0:1790972709.190091:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790972709.190235:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23384:x1877970397668480:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1790972709.190263:0:24150:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00010000:00080000:0.0:1790972709.191810:0:23384:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3d5bdf80 x1877970397668480/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790972725 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972709.191827:0:23384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23384:1877970397668480:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1790972709.191900:0:23384:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1790972709.191944:0:23384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23384:1877970397668608:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1790972709.196760:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23384:x1877970397668480:12345-0@lo:5:osp-pre-0-1.0 Request processed in 6518us (7276us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972709.196777:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790972709.197133:0:23384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972709.197179:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397668608 00000100:00100000:1.0:1790972709.197190:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397668608 00000100:00100000:1.0:1790972709.197243:0:24147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790972709.197254:0:24147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23384:x1877970397668608:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1790972709.197313:0:24147:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:0.0:1790972709.197902:0:23384:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06adce40 going to sleep for 11 seconds 00000001:00080000:0.0:1790972709.236067:0:24144:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1790972709.236081:0:24144:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1790972709.236448:0:24147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23384:x1877970397668608:12345-0@lo:5:osp-pre-0-1.0 Request processed in 39192us (39311us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1790972709.236460:0:24147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790972709.236622:0:23384:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3d5bdf80 x1877970397668608/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790972725 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972709.236634:0:23384:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1790972709.236641:0:23384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23384:1877970397668608:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1790972709.236906:0:23384:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1790972709.236966:0:23384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23384:1877970397668736:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790972709.237021:0:23384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972709.237047:0:23384:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06adce40 going to sleep for 11 seconds 00000100:00100000:3.0:1790972709.237102:0:22654:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397668736 00000100:00100000:3.0:1790972709.237108:0:22654:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397668736 00000100:00100000:3.0:1790972709.237144:0:22654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790972709.237152:0:22654:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23384:x1877970397668736:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1790972709.238410:0:22654:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23384:x1877970397668736:12345-0@lo:900:osp-pre-0-1.0 Request processed in 1255us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972709.238420:0:22654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790972709.238478:0:23384:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3a7d3b80 x1877970397668736/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790972725 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972709.238490:0:23384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23384:1877970397668736:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1790972709.432293:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972710.135057:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790972710.135078:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397668864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790972710.135157:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972710.135202:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397668864 00000100:00100000:2.0:1790972710.135211:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397668864 00000100:00100000:2.0:1790972710.135253:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790972710.135261:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397668864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790972710.135305:0:23382:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790972710.135349:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397668864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972710.135356:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790972710.135402:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397668864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790972710.137149:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397668992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790972710.137210:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972710.137781:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397668992 00000100:00100000:3.0:1790972710.137790:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397668992 00000100:00100000:3.0:1790972710.137837:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790972710.137845:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397668992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790972710.137875:0:22647:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790972710.140925:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397668992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3070us (3704us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972710.140939:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790972710.141055:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397668992:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1790972710.457453:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790972710.774864:0:22676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790972711.480125:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972712.500882:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972713.276534:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972693/real 1790972693] req@ffff888e3fa01500 x1877970397659008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972713 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972713.276565:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e3fa01500 x1877970397659008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972713 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972713.276577:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790972693/real 1790972693] req@ffff888e3fa01880 x1877970397659136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972713 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972713.276600:0:3637:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff888e3fa01880 x1877970397659136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790972713 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790972713.276617:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e394b7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790972713.276643:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790972713.276647:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397659008:0@lo:8:kworker.0 00000100:00080000:0.0:1790972713.276675:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d07d6a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790972713.276681:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1790972713.276684:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397659136:0@lo:8:kworker.0 00000100:00080000:3.0:1790972713.276885:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972713.276889:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1790972713.276891:0:38:0:(import.c:65:import_set_state_nolock()) ffff888e394b7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790972713.276896:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 631 00000100:00080000:3.0:1790972713.276901:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790972713.276912:0:38:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff888e394b7000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1790972713.276939:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3a7d2d80 x1877970397669376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790972713.276952:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972713.276955:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790972713.276956:0:38:0:(import.c:65:import_set_state_nolock()) ffff888d07d6a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790972713.276960:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 631 00000100:00080000:3.0:1790972713.276962:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790972713.276967:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff888d07d6a000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1790972713.276989:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3a7d1500 x1877970397669504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790972713.277027:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790972713.277030:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1790972713.277032:0:38:0:(import.c:65:import_set_state_nolock()) ffff888d05dfd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790972713.277035:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 647 00000100:00080000:3.0:1790972713.277038:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1790972713.277042:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff888d05dfd000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:3.0:1790972713.277052:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3d521500 x1877970397670016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790972713.277105:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397669248:0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277169:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.277215:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877970397670144:0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277241:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.277263:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1790972713.277268:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397669120:0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277307:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.277329:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397669888:0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277350:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.277374:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877970397669632:0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277394:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.277409:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877970397670272:0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277431:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.277447:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1790972713.277452:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397669760:0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277470:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.277485:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877970397670400:0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277506:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.277536:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397669248 00000100:00100000:3.0:1790972713.277543:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397669248 00000100:00100000:3.0:1790972713.277575:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397669760 00000100:00100000:3.0:1790972713.277577:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397669760 00000100:00100000:3.0:1790972713.277593:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790972713.277601:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397669248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277683:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d570000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397669248:12345-0@lo:400:kworker.0 Request processed in 49us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.277690:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790972713.277707:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790972713.277713:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397669760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277744:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d572680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397669760:12345-0@lo:400:kworker.0 Request processed in 32us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.277758:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790972713.277776:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397670144 00000100:00100000:3.0:1790972713.277780:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397670144 00000100:00100000:3.0:1790972713.277796:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397669632 00000100:00100000:3.0:1790972713.277798:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397669632 00000100:00100000:3.0:1790972713.277806:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397670272 00000100:00100000:3.0:1790972713.277808:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397670272 00000100:00100000:3.0:1790972713.277828:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397670400 00000100:00100000:3.0:1790972713.277830:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397670400 00000100:00100000:3.0:1790972713.277843:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790972713.277848:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877970397670144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277877:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d572a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877970397670144:12345-0@lo:400:kworker.0 Request processed in 30us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.277883:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790972713.277893:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790972713.277898:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877970397669632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277920:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d570a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1877970397669632:12345-0@lo:400:kworker.0 Request processed in 22us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.277924:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790972713.277934:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790972713.277940:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877970397670272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.277964:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d570380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877970397670272:12345-0@lo:400:kworker.0 Request processed in 24us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.277969:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790972713.277978:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790972713.277983:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877970397670400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.278018:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d571880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1877970397670400:12345-0@lo:400:kworker.0 Request processed in 35us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.278023:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790972713.278042:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397669120 00000100:00100000:3.0:1790972713.278045:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397669120 00000100:00100000:3.0:1790972713.278083:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790972713.278089:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:3641:x1877970397669120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.278118:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:3641:x1877970397669120:12345-0@lo:400:kworker.0 Request processed in 29us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.278123:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790972713.278147:0:24693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397669888 00000100:00100000:3.0:1790972713.278150:0:24693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397669888 00000100:00100000:3.0:1790972713.278185:0:24693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790972713.278191:0:24693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397669888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.278220:0:24693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d573b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397669888:12345-0@lo:400:kworker.0 Request processed in 29us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.278225:0:24693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790972713.278268:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397669120:0@lo:400:kworker.0 00010000:00080000:3.0:1790972713.278280:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3a7d0700 x1877970397669888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790972729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972713.278289:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397669888:0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.278297:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397669248:0@lo:400:kworker.0 00010000:00080000:3.0:1790972713.278305:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3d571180 x1877970397670144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972713.278326:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877970397670144:0@lo:400:kworker.0 00000100:00100000:3.0:1790972713.278362:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397669760:0@lo:400:kworker.0 00010000:00080000:3.0:1790972713.278372:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3d573480 x1877970397670400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972713.278380:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3638:1877970397670400:0@lo:400:kworker.0 00010000:00080000:3.0:1790972713.278388:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3a7d2680 x1877970397669632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972713.278395:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3638:1877970397669632:0@lo:400:kworker.0 00010000:00080000:3.0:1790972713.278404:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3d573100 x1877970397670272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972729 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972713.278411:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877970397670272:0@lo:400:kworker.0 00000100:00100000:0.0:1790972713.278711:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397669376:0@lo:8:kworker.0 00000100:00100000:0.0:1790972713.278747:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.278779:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397669504:0@lo:8:kworker.0 00000100:00100000:0.0:1790972713.278797:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.278812:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397670016:0@lo:8:kworker.0 00000100:00100000:0.0:1790972713.278832:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.279332:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397669376 00000100:00100000:3.0:1790972713.279339:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397669376 00000100:00100000:3.0:1790972713.279357:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397669504 00000100:00100000:3.0:1790972713.279360:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397669504 00000100:00100000:3.0:1790972713.279367:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397670016 00000100:00100000:3.0:1790972713.279368:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397670016 00000100:00100000:3.0:1790972713.279378:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790972713.279383:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1877970397669376:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1790972713.279409:0:24149:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 651 last 0 00000020:00000080:3.0:1790972713.279436:0:24149:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd61f4faa13a11b33 00002000:00100000:3.0:1790972713.279450:0:24149:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff888d05daa800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790972713.279454:0:24149:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1790972713.279463:0:24149:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790972713.279532:0:24149:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790972713.279555:0:24149:0:(import.c:65:import_set_state_nolock()) ffff888d05dae000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790972713.279613:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3637:x1877970397669376:12345-0@lo:8:kworker.0 Request processed in 229us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.279620:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790972713.279634:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790972713.279638:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1877970397669504:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1790972713.279676:0:24149:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790972713.279701:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1877970397669504:12345-0@lo:8:kworker.0 Request processed in 61us (902us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790972713.279707:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790972713.279718:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790972713.279721:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1877970397670016:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1790972713.279731:0:24149:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1790972713.279752:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1877970397670016:12345-0@lo:8:kworker.0 Request processed in 29us (919us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790972713.279758:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790972713.280073:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3a7d2d80 x1877970397669376/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790972738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972713.280084:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1790972713.280091:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1790972713.280098:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1790972713.280103:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1790972713.280106:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888e394b7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1790972713.280120:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1790972713.280125:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397669376:0@lo:8:kworker.0 00000004:00080000:0.0:1790972713.280175:0:22667:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:0.0:1790972713.280194:0:22667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22667:1877970397670656:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790972713.280227:0:22667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.280242:0:22667:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e15dcec00 going to sleep for 11 seconds 00000004:00080000:0.0:1790972713.280257:0:22666:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1790972713.280321:0:22666:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 651307658060ns, next at 0ns, rc = 0 00080000:00080000:0.0:1790972713.280327:0:22666:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1790972713.280399:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397670528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790972713.280427:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790972713.280463:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d07d6a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790972713.280467:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790972713.280469:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397669504:0@lo:8:kworker.0 00000100:00080000:0.0:1790972713.280476:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d05dfd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790972713.280479:0:3637:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790972713.280481:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397670016:0@lo:8:kworker.0 00000100:00100000:3.0:1790972713.280547:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397670656 00000100:00100000:3.0:1790972713.280553:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397670656 00000100:00100000:3.0:1790972713.280598:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790972713.280605:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22667:x1877970397670656:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1790972713.281135:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790972713.281141:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1790972713.281144:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790972713.281619:0:24151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397670528 00000100:00100000:3.0:1790972713.281626:0:24151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397670528 00000100:00100000:3.0:1790972713.282029:0:24151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790972713.282040:0:24151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1877970397670528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790972713.282083:0:24151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790972713.282149:0:24151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3640:x1877970397670528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.282156:0:24151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1790972713.282219:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3d5bf480 x1877970397670528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790972729 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972713.282239:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397670528:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1790972713.283122:0:22622:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1790972713.287875:0:24149:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1790972713.287888:0:24149:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1790972713.287895:0:24149:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00002000:00010000:1.0:1790972713.308614:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972713.308628:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002525c91c/0xd61f4faa13a11b3a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.308646:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1790972713.309078:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972713.309087:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002525c91c/0xd61f4faa13a11b3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.309108:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002525c91c/0xd61f4faa13a11b3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.309120:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002525c91c/0xd61f4faa13a11b3a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.309128:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002525c91c/0xd61f4faa13a11b3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.309167:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.309192:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.309199:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002525c91c/0xd61f4faa13a11b3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.309207:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e09feba00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.309212:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002525c91c/0xd61f4faa13a11b3a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.309222:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002525c91c/0xd61f4faa13a11b3a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.309239:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002525c91c/0xd61f4faa13a11b3a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.309246:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002525c91c/0xd61f4faa13a11b3a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.309266:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.309274:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.309276:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972713.312318:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972713.312333:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb636a4f/0xd61f4faa13a11b41 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.312352:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1790972713.312357:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972713.312364:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb636a4f/0xd61f4faa13a11b41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.312378:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb636a4f/0xd61f4faa13a11b41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.312388:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb636a4f/0xd61f4faa13a11b41 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.312397:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb636a4f/0xd61f4faa13a11b41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.312421:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.312728:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.312736:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb636a4f/0xd61f4faa13a11b41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.312745:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e09fea200 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.312749:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb636a4f/0xd61f4faa13a11b41 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.312759:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb636a4f/0xd61f4faa13a11b41 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.312776:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb636a4f/0xd61f4faa13a11b41 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.312783:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb636a4f/0xd61f4faa13a11b41 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.312801:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.312803:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.312805:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972713.312989:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972713.312995:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044bd219f/0xd61f4faa13a11b48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.313004:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1790972713.313131:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972713.313137:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044bd219f/0xd61f4faa13a11b48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.313149:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044bd219f/0xd61f4faa13a11b48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.313157:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044bd219f/0xd61f4faa13a11b48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.313164:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044bd219f/0xd61f4faa13a11b48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.313185:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.313508:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.313514:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044bd219f/0xd61f4faa13a11b48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.313522:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1ea800 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.313526:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044bd219f/0xd61f4faa13a11b48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.313541:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044bd219f/0xd61f4faa13a11b48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.313555:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044bd219f/0xd61f4faa13a11b48 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.313563:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044bd219f/0xd61f4faa13a11b48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.313581:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.313583:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.313584:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972713.314195:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972713.314202:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000498b5273/0xd61f4faa13a11b4f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.314284:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1790972713.314288:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972713.314292:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000498b5273/0xd61f4faa13a11b4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.314302:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000498b5273/0xd61f4faa13a11b4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.314310:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000498b5273/0xd61f4faa13a11b4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.314326:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000498b5273/0xd61f4faa13a11b4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.314347:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.314488:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.314495:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000498b5273/0xd61f4faa13a11b4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.314503:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eb000 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.314506:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000498b5273/0xd61f4faa13a11b4f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.314514:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000498b5273/0xd61f4faa13a11b4f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.314526:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000498b5273/0xd61f4faa13a11b4f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.314545:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000498b5273/0xd61f4faa13a11b4f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.314562:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.314563:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.314565:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972713.314776:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972713.314782:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004096d521/0xd61f4faa13a11b56 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.314790:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1790972713.314794:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972713.314798:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004096d521/0xd61f4faa13a11b56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.314807:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004096d521/0xd61f4faa13a11b56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.314814:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004096d521/0xd61f4faa13a11b56 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.314822:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004096d521/0xd61f4faa13a11b56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.314842:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.315188:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.315194:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004096d521/0xd61f4faa13a11b56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.315202:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1ea000 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.315205:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004096d521/0xd61f4faa13a11b56 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.315214:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004096d521/0xd61f4faa13a11b56 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.315226:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004096d521/0xd61f4faa13a11b56 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.315232:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004096d521/0xd61f4faa13a11b56 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.315247:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.315249:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.315250:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.315360:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.315366:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056efe0bb/0xd61f4faa13a11b5d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.315375:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.315378:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.315382:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056efe0bb/0xd61f4faa13a11b5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.315392:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056efe0bb/0xd61f4faa13a11b5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.315410:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056efe0bb/0xd61f4faa13a11b5d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.315417:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056efe0bb/0xd61f4faa13a11b5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.315436:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.315730:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.315736:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056efe0bb/0xd61f4faa13a11b5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.315744:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdca00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.315747:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056efe0bb/0xd61f4faa13a11b5d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.315755:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056efe0bb/0xd61f4faa13a11b5d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.315767:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056efe0bb/0xd61f4faa13a11b5d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.315774:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056efe0bb/0xd61f4faa13a11b5d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.315790:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.315792:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.315794:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.315949:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.315955:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095ba7aad/0xd61f4faa13a11b64 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.315963:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.315967:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.315971:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095ba7aad/0xd61f4faa13a11b64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.316035:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095ba7aad/0xd61f4faa13a11b64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.316042:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095ba7aad/0xd61f4faa13a11b64 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.316050:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095ba7aad/0xd61f4faa13a11b64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.316116:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790972713.317250:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.317258:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11b6b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.317272:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.317276:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.317280:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11b6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.317291:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11b6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.317300:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11b6b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.317307:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11b6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.320579:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790972713.320594:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095ba7aad/0xd61f4faa13a11b64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.320607:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc600 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.320612:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095ba7aad/0xd61f4faa13a11b64 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.320644:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095ba7aad/0xd61f4faa13a11b64 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.320680:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095ba7aad/0xd61f4faa13a11b64 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.320689:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095ba7aad/0xd61f4faa13a11b64 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.320708:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.320712:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11b6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.320719:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdd600 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.320723:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11b6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.320731:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11b6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.320741:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11b6b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.320748:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.320750:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.320758:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972713.322105:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1790972713.322118:0:24149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11b6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.322476:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.326911:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.326927:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3b70377/0xd61f4faa13a11b72 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.326955:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.326959:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.326966:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3b70377/0xd61f4faa13a11b72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.326993:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3b70377/0xd61f4faa13a11b72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.327005:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3b70377/0xd61f4faa13a11b72 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.327013:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3b70377/0xd61f4faa13a11b72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.327036:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.327268:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.327276:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3b70377/0xd61f4faa13a11b72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.327284:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdd400 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.327288:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3b70377/0xd61f4faa13a11b72 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.327297:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3b70377/0xd61f4faa13a11b72 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.327314:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3b70377/0xd61f4faa13a11b72 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.327322:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3b70377/0xd61f4faa13a11b72 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.327338:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.327340:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.327341:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.328495:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.328507:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11b79 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.328520:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.328524:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.328529:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11b79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.328541:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11b79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.328566:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11b79 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.328574:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11b79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.328600:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.328822:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.328830:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11b79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.328838:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdce00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.328842:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11b79 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.328867:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11b79 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.328891:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11b79 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.328898:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11b79 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.328915:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.328917:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.328919:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972713.329141:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972713.329147:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027bd86af/0xd61f4faa13a11b80 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.329163:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1790972713.329166:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972713.329170:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000027bd86af/0xd61f4faa13a11b80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.329179:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000027bd86af/0xd61f4faa13a11b80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.329186:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000027bd86af/0xd61f4faa13a11b80 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.329192:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000027bd86af/0xd61f4faa13a11b80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.329218:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.329590:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.329596:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000027bd86af/0xd61f4faa13a11b80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.329604:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eb600 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.329608:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000027bd86af/0xd61f4faa13a11b80 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.329616:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000027bd86af/0xd61f4faa13a11b80 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.329628:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000027bd86af/0xd61f4faa13a11b80 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.329649:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000027bd86af/0xd61f4faa13a11b80 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.329700:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.329702:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.329704:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972713.329716:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972713.329721:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11b87 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.329730:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1790972713.329733:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972713.329737:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11b87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.329746:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11b87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.329765:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11b87 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.329772:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11b87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.329794:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.329810:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.329815:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11b87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.329823:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eac00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.329826:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11b87 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.329833:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11b87 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.329844:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11b87 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.329851:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11b87 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.329877:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.329879:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.329881:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972713.330240:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972713.330246:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7698194/0xd61f4faa13a11b8e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.330255:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1790972713.330258:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972713.330262:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e7698194/0xd61f4faa13a11b8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.330271:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e7698194/0xd61f4faa13a11b8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.330279:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e7698194/0xd61f4faa13a11b8e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.330287:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e7698194/0xd61f4faa13a11b8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.330321:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790972713.331193:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972713.331203:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cc8158e/0xd61f4faa13a11b95 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.331223:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1790972713.331227:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972713.331232:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cc8158e/0xd61f4faa13a11b95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.331242:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cc8158e/0xd61f4faa13a11b95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.331250:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cc8158e/0xd61f4faa13a11b95 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.331258:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cc8158e/0xd61f4faa13a11b95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.331313:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1790972713.332420:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972713.332428:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022f19e65/0xd61f4faa13a11b9c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.332451:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1790972713.332464:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972713.332473:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022f19e65/0xd61f4faa13a11b9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.332485:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022f19e65/0xd61f4faa13a11b9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.332494:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000022f19e65/0xd61f4faa13a11b9c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.332502:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000022f19e65/0xd61f4faa13a11b9c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333163:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790972713.333172:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e7698194/0xd61f4faa13a11b8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333182:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eb800 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972713.333186:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7698194/0xd61f4faa13a11b8e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333196:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e7698194/0xd61f4faa13a11b8e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333375:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e7698194/0xd61f4faa13a11b8e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333383:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7698194/0xd61f4faa13a11b8e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333416:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790972713.333420:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cc8158e/0xd61f4faa13a11b95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333427:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eb400 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972713.333431:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cc8158e/0xd61f4faa13a11b95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333448:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cc8158e/0xd61f4faa13a11b95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333459:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cc8158e/0xd61f4faa13a11b95 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333467:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cc8158e/0xd61f4faa13a11b95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333479:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972713.333482:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000022f19e65/0xd61f4faa13a11b9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333488:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eba00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972713.333491:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000022f19e65/0xd61f4faa13a11b9c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333509:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000022f19e65/0xd61f4faa13a11b9c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333519:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000022f19e65/0xd61f4faa13a11b9c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.333526:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972713.333527:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972713.333529:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.334851:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972713.336599:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790972713.336613:0:24149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022f19e65/0xd61f4faa13a11b9c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790972713.339224:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972713.339240:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc472e5/0xd61f4faa13a11ba3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.339257:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1790972713.339263:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972713.339269:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc472e5/0xd61f4faa13a11ba3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.339284:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc472e5/0xd61f4faa13a11ba3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.339309:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc472e5/0xd61f4faa13a11ba3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.339317:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc472e5/0xd61f4faa13a11ba3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.339766:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972713.339774:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc472e5/0xd61f4faa13a11ba3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.339783:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eae00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972713.339788:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc472e5/0xd61f4faa13a11ba3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.339798:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc472e5/0xd61f4faa13a11ba3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.339814:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc472e5/0xd61f4faa13a11ba3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.339823:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972713.339824:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972713.339826:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972713.342340:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790972713.342353:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972713.342356:0:24149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc472e5/0xd61f4faa13a11ba3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790972713.344407:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972713.344421:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041a2d368/0xd61f4faa13a11baa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.344861:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=651s v=(0 0) 00010000:00010000:1.0:1790972713.344868:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972713.344875:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041a2d368/0xd61f4faa13a11baa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.344892:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041a2d368/0xd61f4faa13a11baa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.344903:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041a2d368/0xd61f4faa13a11baa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.344924:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041a2d368/0xd61f4faa13a11baa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.345191:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790972713.345238:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972713.345245:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041a2d368/0xd61f4faa13a11baa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.345253:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1ea400 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972713.345257:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041a2d368/0xd61f4faa13a11baa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.345266:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041a2d368/0xd61f4faa13a11baa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.345282:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041a2d368/0xd61f4faa13a11baa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.345289:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041a2d368/0xd61f4faa13a11baa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.345314:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972713.345316:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972713.345317:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.346700:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.346711:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11bb1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.346726:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.346731:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.346737:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.346750:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.346760:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11bb1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.346769:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.346804:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.346831:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.346839:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.346850:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdd600 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.346855:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.346865:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.346880:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11bb1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.346888:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11bb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.346906:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.346908:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.346910:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.348534:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.348548:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11bb8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.348564:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.348567:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.348573:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.348584:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.348591:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11bb8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.348599:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.348621:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790972713.348691:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972713.348698:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.348705:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc200 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972713.348709:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11bb8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.348736:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11bb8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.348753:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11bb8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.348760:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11bb8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.348776:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972713.348778:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972713.348780:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.350651:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.350694:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bbf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.350710:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.350720:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.350725:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.350737:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.350746:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bbf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.350754:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.350771:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790972713.350782:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790972713.350787:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.350795:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc800 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972713.350799:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bbf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.350807:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bbf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.350821:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bbf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.350837:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bbf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.353042:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972713.353053:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972713.353056:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.354566:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.354579:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f27b8906/0xd61f4faa13a11bc6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.354595:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.354599:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.354605:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f27b8906/0xd61f4faa13a11bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.354619:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f27b8906/0xd61f4faa13a11bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.354629:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f27b8906/0xd61f4faa13a11bc6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.354637:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f27b8906/0xd61f4faa13a11bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.354687:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.355969:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.355980:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f27b8906/0xd61f4faa13a11bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.355991:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdd800 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.355996:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f27b8906/0xd61f4faa13a11bc6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.356015:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f27b8906/0xd61f4faa13a11bc6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.356036:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f27b8906/0xd61f4faa13a11bc6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.356043:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f27b8906/0xd61f4faa13a11bc6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.356075:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.356077:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.356079:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.357572:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.357589:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015fdde4d/0xd61f4faa13a11bcd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.357604:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.357609:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.357614:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015fdde4d/0xd61f4faa13a11bcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.357628:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015fdde4d/0xd61f4faa13a11bcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.357638:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015fdde4d/0xd61f4faa13a11bcd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.357646:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015fdde4d/0xd61f4faa13a11bcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.359966:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.360379:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.360388:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015fdde4d/0xd61f4faa13a11bcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.360401:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdcc00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.360406:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015fdde4d/0xd61f4faa13a11bcd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.360416:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015fdde4d/0xd61f4faa13a11bcd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.360435:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015fdde4d/0xd61f4faa13a11bcd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.360455:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015fdde4d/0xd61f4faa13a11bcd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.360479:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.360481:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.360482:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.360647:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.360655:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007df9216a/0xd61f4faa13a11bd4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.360691:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.360696:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.360702:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007df9216a/0xd61f4faa13a11bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.360714:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007df9216a/0xd61f4faa13a11bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.360730:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007df9216a/0xd61f4faa13a11bd4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.360738:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007df9216a/0xd61f4faa13a11bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.360755:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.361482:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.361489:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007df9216a/0xd61f4faa13a11bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.361498:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc400 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.361502:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007df9216a/0xd61f4faa13a11bd4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.361511:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007df9216a/0xd61f4faa13a11bd4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.361525:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007df9216a/0xd61f4faa13a11bd4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.361531:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007df9216a/0xd61f4faa13a11bd4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.361549:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.361551:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.361553:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.363551:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.363563:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be14cb8c/0xd61f4faa13a11bdb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.363581:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.363586:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.363592:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be14cb8c/0xd61f4faa13a11bdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.363604:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be14cb8c/0xd61f4faa13a11bdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.363614:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be14cb8c/0xd61f4faa13a11bdb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.363622:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be14cb8c/0xd61f4faa13a11bdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.363651:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.367564:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.367581:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be14cb8c/0xd61f4faa13a11bdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.367596:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bddc00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.367600:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be14cb8c/0xd61f4faa13a11bdb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.367611:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be14cb8c/0xd61f4faa13a11bdb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.367633:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be14cb8c/0xd61f4faa13a11bdb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.367641:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be14cb8c/0xd61f4faa13a11bdb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.367687:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.367690:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.367692:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.368578:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.368589:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a50630/0xd61f4faa13a11be2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.368604:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.368609:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.368615:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040a50630/0xd61f4faa13a11be2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.368627:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040a50630/0xd61f4faa13a11be2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.368637:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040a50630/0xd61f4faa13a11be2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.368645:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040a50630/0xd61f4faa13a11be2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.368689:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.369133:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.369140:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040a50630/0xd61f4faa13a11be2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.369149:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdd000 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.369153:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a50630/0xd61f4faa13a11be2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.369175:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040a50630/0xd61f4faa13a11be2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.369190:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040a50630/0xd61f4faa13a11be2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.369198:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040a50630/0xd61f4faa13a11be2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.369216:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.369219:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.369220:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.370047:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.370056:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa4ba933/0xd61f4faa13a11be9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.370078:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.370090:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.370096:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4ba933/0xd61f4faa13a11be9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.370107:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa4ba933/0xd61f4faa13a11be9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.370116:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa4ba933/0xd61f4faa13a11be9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.370123:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa4ba933/0xd61f4faa13a11be9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.370144:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.370309:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.370315:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa4ba933/0xd61f4faa13a11be9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.370323:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdd200 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.370327:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa4ba933/0xd61f4faa13a11be9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.370335:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa4ba933/0xd61f4faa13a11be9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.370360:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa4ba933/0xd61f4faa13a11be9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.370379:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa4ba933/0xd61f4faa13a11be9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.370393:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.370395:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.370397:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.372579:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.372590:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000240b018/0xd61f4faa13a11bf0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.372605:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.372610:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.372616:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000240b018/0xd61f4faa13a11bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.372627:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000240b018/0xd61f4faa13a11bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.372637:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000240b018/0xd61f4faa13a11bf0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.372658:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000240b018/0xd61f4faa13a11bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.372706:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972713.372961:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.372969:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000240b018/0xd61f4faa13a11bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.372977:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdda00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.372982:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000240b018/0xd61f4faa13a11bf0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.372991:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000240b018/0xd61f4faa13a11bf0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.373006:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000240b018/0xd61f4faa13a11bf0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.373013:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000240b018/0xd61f4faa13a11bf0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.373032:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.373034:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.373036:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.375768:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.375783:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bf7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.375800:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.375804:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.375811:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.375825:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.375835:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.375842:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.375880:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790972713.376122:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790972713.376130:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.376138:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc800 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:1.0:1790972713.376143:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.376153:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.376169:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bf7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.376176:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ae89f80/0xd61f4faa13a11bf7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.376193:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972713.376195:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972713.376197:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.378285:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.378298:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aee0bdd/0xd61f4faa13a11bfe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.378320:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.378324:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.378330:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aee0bdd/0xd61f4faa13a11bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.378342:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aee0bdd/0xd61f4faa13a11bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.378362:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aee0bdd/0xd61f4faa13a11bfe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.378370:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aee0bdd/0xd61f4faa13a11bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.378396:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790972713.378523:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972713.378530:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aee0bdd/0xd61f4faa13a11bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.378538:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdde00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972713.378542:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aee0bdd/0xd61f4faa13a11bfe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.378551:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aee0bdd/0xd61f4faa13a11bfe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.378566:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aee0bdd/0xd61f4faa13a11bfe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.378585:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aee0bdd/0xd61f4faa13a11bfe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.378605:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972713.378607:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972713.378608:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.380109:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.380120:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11c05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.380134:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.380138:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.380143:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.380165:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.380187:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11c05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.380195:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.380215:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790972713.380290:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790972713.380297:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.380310:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc200 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:1.0:1790972713.380314:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11c05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.380323:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11c05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.380339:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11c05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.380346:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f77d6151/0xd61f4faa13a11c05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972713.380366:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972713.380368:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972713.380369:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.382920:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.382935:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11c0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.382952:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.382956:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.382961:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11c0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.382974:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11c0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.382994:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11c0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.383002:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11c0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.383033:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790972713.383808:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972713.383816:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11c0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.383826:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdd600 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972713.383831:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11c0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.383841:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11c0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.383859:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11c0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.383867:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2a673ec/0xd61f4faa13a11c0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.383890:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972713.383892:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972713.383894:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972713.384834:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972713.384844:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11c13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.384866:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=651s v=(0 0) 00010000:00010000:0.0:1790972713.384871:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972713.384877:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11c13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.384889:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11c13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.384899:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11c13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.384907:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11c13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.384929:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1790972713.385256:0:24149:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1790972713.385519:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22667:x1877970397670656:12345-0@lo:5:osp-pre-0-0.0 Request processed in 104738us (105115us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972713.385531:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790972713.385586:0:22667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22667:1877970397670656:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790972713.385611:0:22667:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:0.0:1790972713.385657:0:22667:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22667:1877970397670784:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1790972713.385713:0:22667:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.385742:0:22667:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3477a300 going to sleep for 11 seconds 00000100:00100000:0.0:1790972713.385757:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397670784 00000100:00100000:0.0:1790972713.385763:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397670784 00000100:00100000:0.0:1790972713.385799:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790972713.385807:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22667:x1877970397670784:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1790972713.385841:0:24149:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:3.0:1790972713.387126:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972713.387137:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11c13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.387149:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdce00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972713.387153:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11c13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.387165:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11c13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.387185:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11c13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.387193:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000302b836e/0xd61f4faa13a11c13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.387228:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.387230:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972713.387232:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1790972713.392925:0:24144:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:3.0:1790972713.393000:0:24144:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790972713.393267:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22667:x1877970397670784:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7456us (7549us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1790972713.393278:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790972713.393346:0:22667:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1790972713.393365:0:22667:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22667:1877970397670784:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790972713.393382:0:22667:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:2.0:1790972713.524897:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790972713.620861:0:24961:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790972713.620865:0:24961:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1790972713.620866:0:24961:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1790972713.620977:0:24961:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff888e3fa28800 00000020:01000004:2.0:1790972713.620993:0:24961:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790972713.621007:0:24961:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1790972713.621021:0:24961:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff888e2d0f4d40) 00000020:00000080:2.0:1790972713.621038:0:24961:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1790972713.739223:0:24961:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1790972713.744600:0:24961:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1790972713.746310:0:24961:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1790972713.747254:0:24961:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1790972713.748525:0:24961:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1790972713.749500:0:24961:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1790972713.749779:0:24961:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1790972713.752258:0:24961:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1790972713.752583:0:24961:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790972713.752600:0:24961:0:(osd_handler.c:8931:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790972713.752612:0:24961:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd61f4faa13a11c21 00000020:01000004:3.0:1790972713.752624:0:24961:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1790972713.752649:0:24961:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.139@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790972713.752652:0:24961:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.139@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790972713.752659:0:24961:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790972713.752737:0:24961:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1790972713.752741:0:24961:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.139@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1790972713.764155:0:24961:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.139@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790972713.764194:0:24961:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.139@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1790972713.764199:0:24961:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790972713.764200:0:24961:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790972713.764202:0:24961:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790972713.764203:0:24961:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790972713.764204:0:24961:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790972713.764206:0:24961:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790972713.764207:0:24961:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790972713.764209:0:24961:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790972713.764211:0:24961:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790972713.764215:0:24961:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1790972713.764217:0:24961:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790972713.764218:0:24961:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790972713.764219:0:24961:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790972713.764220:0:24961:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790972713.764221:0:24961:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790972713.764222:0:24961:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790972713.764229:0:24961:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790972713.764230:0:24961:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790972713.764231:0:24961:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790972713.764255:0:24961:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790972713.764276:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397670912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790972713.764417:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.764520:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7840 going to sleep for 11 seconds 00000100:00100000:2.0:1790972713.764630:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397670912 00000100:00100000:2.0:1790972713.764638:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397670912 00000100:00100000:2.0:1790972713.764805:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1790972713.764815:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24961:x1877970397670912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790972713.764852:0:22634:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1790972713.764855:0:22634:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1790972713.764860:0:22634:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790972713.765382:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24961:x1877970397670912:12345-0@lo:253:mount.lustre.0 Request processed in 567us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972713.765391:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1790972713.765468:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397670912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790972713.765479:0:24961:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790972713.765481:0:24961:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790972713.765482:0:24961:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790972713.765483:0:24961:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790972713.765485:0:24961:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790972713.765485:0:24961:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790972713.765487:0:24961:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790972713.765488:0:24961:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790972713.765489:0:24961:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790972713.765490:0:24961:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790972713.765507:0:24961:0:(tgt_mount.c:101:server_register_mount()) register mount ffff888e3fa28800 from lustre-OST0001 10000000:01000000:0.0:1790972713.765532:0:24961:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1790972713.765534:0:24961:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790972713.765543:0:24961:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff888d0695b380 local copy 00010000:00010000:0.0:1790972713.765553:0:24961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972713.765652:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790972713.765704:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.766038:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7480 going to sleep for 11 seconds 00000100:00100000:3.0:1790972713.766213:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397671040 00000100:00100000:3.0:1790972713.766221:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397671040 00000100:00100000:1.0:1790972713.766435:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1790972713.766445:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24961:x1877970397671040:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790972713.766567:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24961:x1877970397671040:12345-0@lo:501:mount.lustre.0 Request processed in 123us (862us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790972713.766574:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1790972713.766657:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671040:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1790972713.766702:0:24961:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.139@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1790972713.766722:0:24961:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.139@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1790972713.766739:0:24961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.766748:0:24961:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3d3cc000/0xd61f4faa13a11854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a1185b expref: -99 pid: 22621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972713.766776:0:24961:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff888e3fa28800 10000000:01000000:0.0:1790972713.766781:0:24961:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1790972713.766787:0:24961:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1790972713.766790:0:24961:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790972713.766794:0:24961:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1790972713.766797:0:24961:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1790972713.766821:0:24961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d06bdd400/0xd61f4faa13a11c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.766829:0:24961:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888d06bdd400/0xd61f4faa13a11c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.766838:0:24961:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888d06bdd400/0xd61f4faa13a11c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972713.766853:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790972713.766882:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.766901:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7480 going to sleep for 11 seconds 00000100:00100000:3.0:1790972713.767118:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397671168 00000100:00100000:3.0:1790972713.767123:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397671168 00000100:00100000:3.0:1790972713.767160:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790972713.767168:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:24961:x1877970397671168:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790972713.767178:0:22636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972713.767190:0:22636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3ad43600/0xd61f4faa13a11c2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11c28 expref: -99 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.767225:0:22636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3ad43600/0xd61f4faa13a11c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11c28 expref: 22 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.767235:0:22636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3ad43600/0xd61f4faa13a11c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11c28 expref: 22 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.767243:0:22636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad43600, rc 0) 00000100:00100000:3.0:1790972713.767284:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:24961:x1877970397671168:12345-0@lo:101:mount.lustre.0 Request processed in 117us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.767290:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1790972713.767453:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790972713.767466:0:24961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888d06bdd400/0xd61f4faa13a11c28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11c2f expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.767475:0:24961:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888d06bdd400/0xd61f4faa13a11c28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11c2f expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790972713.768578:0:24961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1790972713.769295:0:24961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790972713.771826:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1790972713.771885:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1790972713.771901:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1790972713.771914:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1790972713.771926:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1790972713.771940:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1790972713.771954:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1790972713.771969:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1790972713.772086:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1790972713.772117:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1790972713.772122:0:24961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1790972713.772227:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790972713.772296:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.772338:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7540 going to sleep for 11 seconds 00000100:00100000:3.0:1790972713.772518:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397671296 00000100:00100000:3.0:1790972713.772527:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397671296 00000100:00100000:3.0:1790972713.772568:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790972713.772576:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:24961:x1877970397671296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790972713.772771:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:24961:x1877970397671296:12345-0@lo:501:mount.lustre.0 Request processed in 194us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.772780:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790972713.772996:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671296:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790972713.773150:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790972713.773192:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.773224:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7540 going to sleep for 11 seconds 00000100:00100000:2.0:1790972713.773274:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397671424 00000100:00100000:2.0:1790972713.773280:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397671424 00000100:00100000:2.0:1790972713.773314:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790972713.773322:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:24961:x1877970397671424:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790972713.774188:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:24961:x1877970397671424:12345-0@lo:503:mount.lustre.0 Request processed in 864us (993us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972713.774202:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1790972713.774295:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671424:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790972713.774722:0:24961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790972713.774792:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790972713.774836:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.774859:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d5b7480 going to sleep for 11 seconds 00000100:00100000:2.0:1790972713.775118:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397671552 00000100:00100000:2.0:1790972713.775125:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397671552 00000100:00100000:2.0:1790972713.775172:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790972713.775181:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:24961:x1877970397671552:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972713.775749:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:24961:x1877970397671552:12345-0@lo:502:mount.lustre.0 Request processed in 569us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972713.775757:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790972713.775934:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5be680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790972713.776281:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1790972713.776312:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1790972713.776328:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1790972713.776341:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1790972713.776433:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1790972713.776448:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1790972713.776463:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1790972713.776476:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1790972713.776490:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:3.0:1790972713.776520:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671680:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790972713.776567:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.776652:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3adef300 going to sleep for 11 seconds 00000100:00100000:1.0:1790972713.776836:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397671680 00000100:00100000:1.0:1790972713.776849:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397671680 00000100:00100000:1.0:1790972713.776927:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1790972713.776935:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:24961:x1877970397671680:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790972713.777055:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:24961:x1877970397671680:12345-0@lo:502:mount.lustre.0 Request processed in 120us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972713.777072:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790972713.777150:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671680:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790972713.777199:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:3.0:1790972713.777208:0:24961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1790972713.778156:0:24965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790972713.778163:0:24965:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1790972713.778170:0:24965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790972713.778172:0:24965:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1790972713.778177:0:24965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790972713.778191:0:24965:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff888e3d8199c0) 00000020:00000080:3.0:1790972713.778215:0:24965:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790972713.778221:0:24965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790972713.778281:0:24965:0:(tgt_mount.c:153:server_get_mount()) get mount ffff888e3fa28800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1790972713.778295:0:24965:0:(osd_handler.c:8931:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790972713.778301:0:24965:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd61f4faa13a11c3d 00010000:00010000:0.0:1790972713.783174:0:24965:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:0.0:1790972713.783632:0:24965:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:0.0:1790972713.785343:0:24965:0:(osd_handler.c:5587:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1790972713.786644:0:24965:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1790972713.786657:0:24965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790972713.786708:0:24965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790972713.786710:0:24965:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1790972713.786715:0:24965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790972713.786720:0:24965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790972713.786721:0:24965:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1790972713.786724:0:24965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790972713.786726:0:24965:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1790972713.786728:0:24965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790972713.786730:0:24965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790972713.786731:0:24965:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1790972713.786734:0:24965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790972713.786736:0:24965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790972713.786737:0:24965:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790972713.786740:0:24965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1790972713.786765:0:24965:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790972713.786768:0:24965:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790972713.786770:0:24965:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790972713.786773:0:24965:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1790972713.786938:0:24961:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1790972713.786970:0:24961:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790972713.786994:0:24961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d06bdd400/0xd61f4faa13a11c28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11c2f expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.787007:0:24961:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888d06bdd400/0xd61f4faa13a11c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11c2f expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972713.787098:0:24961:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff888e3fa28800 from 1 10000000:01000000:3.0:1790972713.787101:0:24961:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790972713.787137:0:24961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.787147:0:24961:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.787159:0:24961:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972713.787185:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790972713.787250:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.787285:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e39464540 going to sleep for 11 seconds 00000100:00100000:0.0:1790972713.787478:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397671808 00000100:00100000:0.0:1790972713.787486:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397671808 00000100:00100000:0.0:1790972713.787535:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790972713.787545:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:24961:x1877970397671808:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790972713.787560:0:22637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790972713.787573:0:22637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888d06bdc600/0xd61f4faa13a11c4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11c44 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.787595:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888d06bdc600/0xd61f4faa13a11c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11c44 expref: 23 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.787621:0:22637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888d06bdc600/0xd61f4faa13a11c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11c44 expref: 23 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.787631:0:22637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d06bdc600, rc 0) 00000100:00100000:0.0:1790972713.787700:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:24961:x1877970397671808:12345-0@lo:101:mount.lustre.0 Request processed in 157us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972713.787707:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790972713.789494:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790972713.789520:0:24961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11c4b expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.789533:0:24961:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11c4b expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790972713.791753:0:24961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1790972713.793544:0:24961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790972713.793833:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1790972713.793861:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1790972713.793876:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1790972713.793890:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1790972713.793903:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1790972713.793916:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1790972713.793930:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1790972713.793943:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1790972713.793957:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1790972713.796918:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1790972713.797514:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1790972713.797551:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1790972713.797557:0:24961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1790972713.797693:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790972713.797759:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.797802:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e39464a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790972713.799161:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397671936 00000100:00100000:2.0:1790972713.799173:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397671936 00000100:00100000:2.0:1790972713.799226:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1790972713.799235:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:24961:x1877970397671936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790972713.799401:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:24961:x1877970397671936:12345-0@lo:501:mount.lustre.0 Request processed in 167us (1641us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972713.799409:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790972713.799724:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397671936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790972713.799774:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672064:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790972713.799823:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.799856:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e39464a80 going to sleep for 11 seconds 00000100:00100000:2.0:1790972713.799937:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397672064 00000100:00100000:2.0:1790972713.799941:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397672064 00000100:00100000:2.0:1790972713.799968:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1790972713.799986:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:24961:x1877970397672064:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790972713.800076:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:24961:x1877970397672064:12345-0@lo:503:mount.lustre.0 Request processed in 91us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972713.800084:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790972713.800226:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672064:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790972713.800617:0:24961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790972713.800733:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672192:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790972713.800776:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.800812:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e39464540 going to sleep for 11 seconds 00000100:00100000:2.0:1790972713.800935:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397672192 00000100:00100000:2.0:1790972713.800941:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397672192 00000100:00100000:2.0:1790972713.800983:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790972713.800991:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:24961:x1877970397672192:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972713.801096:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:24961:x1877970397672192:12345-0@lo:502:mount.lustre.0 Request processed in 106us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972713.801103:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1790972713.801145:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972713.801367:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1790972713.801394:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1790972713.801409:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1790972713.801424:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1790972713.801437:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1790972713.801450:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1790972713.801462:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1790972713.801473:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1790972713.801485:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1790972713.801495:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1790972713.801519:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1790972713.801543:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972713.801581:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972713.801605:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397672320 00000100:00100000:2.0:1790972713.801609:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397672320 00000100:00100000:2.0:1790972713.801635:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790972713.801642:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:24961:x1877970397672320:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972713.801734:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:24961:x1877970397672320:12345-0@lo:502:mount.lustre.0 Request processed in 92us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972713.801740:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1790972713.801772:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e05f31cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790972713.801786:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972713.801823:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1790972713.801837:0:24961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1790972713.803806:0:24969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972713.803817:0:24969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972713.803820:0:24969:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790972713.803826:0:24969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff888e3fa28800 00000020:00000080:1.0:1790972713.803829:0:24969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790972713.803839:0:24969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972713.803841:0:24969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972713.803843:0:24969:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790972713.803845:0:24969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972713.803848:0:24969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972713.803849:0:24969:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790972713.803853:0:24969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff888e3fa28800 00000020:00000080:1.0:1790972713.803855:0:24969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790972713.803897:0:24969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972713.803900:0:24969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972713.803901:0:24969:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790972713.803904:0:24969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972713.803906:0:24969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972713.803908:0:24969:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790972713.803911:0:24969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff888e3fa28800 00000020:00000080:1.0:1790972713.803913:0:24969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790972713.803930:0:24969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972713.803933:0:24969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972713.803934:0:24969:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790972713.803936:0:24969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790972713.803938:0:24969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972713.803945:0:24969:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1790972713.803948:0:24969:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff888e3fa28800 00000020:00000080:1.0:1790972713.803950:0:24969:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790972713.804583:0:24969:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790972713.804588:0:24969:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790972713.804589:0:24969:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1790972713.804592:0:24969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1790972713.812131:0:24961:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1790972713.812179:0:24961:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790972713.812240:0:24961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11c4b expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.812254:0:24961:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11c4b expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972713.812319:0:24961:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790972713.812322:0:24961:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff888e3fa28800 10000000:01000000:3.0:1790972713.812325:0:24961:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff888e3fa28800 10000000:01000000:3.0:1790972713.812329:0:24961:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790972713.812335:0:24961:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff888e3fa28800 from 1 10000000:01000000:3.0:1790972713.812337:0:24961:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790972713.812448:0:24961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43a00/0xd61f4faa13a11c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.812458:0:24961:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3ad43a00/0xd61f4faa13a11c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.812470:0:24961:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3ad43a00/0xd61f4faa13a11c52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972713.812495:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790972713.812564:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.812607:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e39464240 going to sleep for 11 seconds 00000100:00100000:2.0:1790972713.812693:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397672448 00000100:00100000:2.0:1790972713.812701:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397672448 00000100:00100000:2.0:1790972713.812745:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1790972713.812754:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:24961:x1877970397672448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790972713.812768:0:22636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972713.812781:0:22636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3d3cc200/0xd61f4faa13a11c59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11c52 expref: -99 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.812803:0:22636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3d3cc200/0xd61f4faa13a11c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11c52 expref: 24 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.812814:0:22636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3d3cc200/0xd61f4faa13a11c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11c52 expref: 24 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972713.812822:0:22636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3d3cc200, rc 0) 00000100:00100000:2.0:1790972713.812862:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a746c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397672448:12345-0@lo:101:mount.lustre.0 Request processed in 109us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972713.812869:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790972713.812966:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790972713.813054:0:24961:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3ad43a00/0xd61f4faa13a11c52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11c59 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972713.813086:0:24961:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3ad43a00/0xd61f4faa13a11c52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11c59 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790972713.816308:0:24961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1790972713.826502:0:24961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790972713.826752:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1790972713.826783:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1790972713.826798:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1790972713.826812:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1790972713.826826:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1790972713.826838:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1790972713.826851:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1790972713.826864:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1790972713.826877:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1790972713.826891:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1790972713.826906:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1790972713.826919:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1790972713.826948:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1790972713.826966:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1790972713.827132:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1790972713.827151:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1790972713.827165:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1790972713.827179:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1790972713.827194:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1790972713.827208:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1790972713.827222:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1790972713.827234:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1790972713.827247:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1790972713.827261:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1790972713.827275:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1790972713.827290:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1790972713.827318:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1790972713.827332:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1790972713.827604:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1790972713.827624:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1790972713.827638:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1790972713.827652:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1790972713.827694:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1790972713.827710:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1790972713.827724:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1790972713.827737:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1790972713.827749:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1790972713.827762:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1790972713.827775:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1790972713.827787:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1790972713.827800:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1790972713.827813:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1790972713.827827:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1790972713.827841:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1790972713.827870:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1790972713.827887:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1790972713.827902:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1790972713.827916:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1790972713.828143:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1790972713.828167:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1790972713.828187:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1790972713.828194:0:24961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1790972713.828301:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790972713.828587:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.828644:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397672576 00000100:00100000:3.0:1790972713.828651:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397672576 00000100:00100000:3.0:1790972713.828723:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790972713.828733:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397672576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790972713.828861:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a745c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397672576:12345-0@lo:501:mount.lustre.0 Request processed in 130us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.828869:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790972713.837827:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e39464180 going to sleep for 11 seconds 00000100:00100000:3.0:1790972713.837880:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790972713.837942:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790972713.838132:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.838261:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e39464180 going to sleep for 11 seconds 00000100:00100000:0.0:1790972713.842170:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397672704 00000100:00100000:0.0:1790972713.842185:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397672704 00000100:00100000:0.0:1790972713.842285:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1790972713.842296:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397672704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790972713.842463:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a747850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397672704:12345-0@lo:503:mount.lustre.0 Request processed in 170us (4332us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972713.842471:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1790972713.842557:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672704:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1790972713.843043:0:24961:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790972713.843144:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972713.843191:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972713.845538:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e060da780 going to sleep for 11 seconds 00000100:00100000:3.0:1790972713.845809:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397672832 00000100:00100000:3.0:1790972713.845818:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397672832 00000100:00100000:3.0:1790972713.845875:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790972713.845885:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397672832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790972713.846047:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a746450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397672832:12345-0@lo:502:mount.lustre.0 Request processed in 163us (2855us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.846055:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1790972713.846283:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972713.846503:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1790972713.846535:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1790972713.846551:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1790972713.846577:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1790972713.846592:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1790972713.846605:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1790972713.846619:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1790972713.846634:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1790972713.846648:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1790972713.846695:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1790972713.846713:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1790972713.846730:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1790972713.846744:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1790972713.846757:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1790972713.846769:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1790972713.846781:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1790972713.846794:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1790972713.846805:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1790972713.846818:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1790972713.846831:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1790972713.846844:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1790972713.846873:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1790972713.846886:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1790972713.846899:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1790972713.846926:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1790972713.846941:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1790972713.846955:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1790972713.846967:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1790972713.847111:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1790972713.847126:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1790972713.847138:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1790972713.847151:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1790972713.847163:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1790972713.847175:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1790972713.847186:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1790972713.847197:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1790972713.847221:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1790972713.847235:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1790972713.847247:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1790972713.847259:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1790972713.847285:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1790972713.847303:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1790972713.847316:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1790972713.847329:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1790972713.847341:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1790972713.847354:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1790972713.847369:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1790972713.847383:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1790972713.847434:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972713.847501:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972713.847531:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e060da780 going to sleep for 11 seconds 00000100:00100000:0.0:1790972713.847608:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397672960 00000100:00100000:0.0:1790972713.847616:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397672960 00000100:00100000:0.0:1790972713.847656:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1790972713.847687:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397672960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790972713.847793:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a744850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397672960:12345-0@lo:502:mount.lustre.0 Request processed in 108us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972713.847801:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790972713.849079:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397672960:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972713.849283:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1790972713.849312:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1790972713.849343:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397673088:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972713.849396:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972713.849431:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397673088 00000100:00100000:2.0:1790972713.849436:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397673088 00000100:00100000:2.0:1790972713.849465:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790972713.849473:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397673088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790972713.849566:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a744450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397673088:12345-0@lo:502:mount.lustre.0 Request processed in 93us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972713.849573:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790972713.849617:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e060da780 going to sleep for 11 seconds 00000100:00100000:2.0:1790972713.849637:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397673088:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1790972713.849728:0:24961:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1790972713.849736:0:24961:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1790972713.853422:0:24975:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790972713.853440:0:24975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff888e169a99c0) 00000020:00000080:1.0:1790972713.853465:0:24975:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:1.0:1790972713.853550:0:24975:0:(tgt_mount.c:153:server_get_mount()) get mount ffff888e3fa28800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790972713.853554:0:24975:0:(tgt_mount.c:187:server_put_mount()) put mount ffff888e3fa28800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790972713.853556:0:24975:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888e3fa28800 3 00010000:00080000:1.0:1790972713.853585:0:24975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888d07a95800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.139@tcp at head 00010000:00010000:2.0:1790972713.855877:0:24975:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1790972713.856507:0:24975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790972713.856553:0:24975:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790972713.856565:0:24975:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd61f4faa13a11c67 00000100:00080000:2.0:1790972713.856575:0:24975:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790972713.856586:0:24975:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff888d07a95800 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1790972713.856617:0:24975:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3f74fb80 x1877970397673216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790972713.856690:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877970397673216:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790972713.856754:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790972713.856831:0:24975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1790972713.860311:0:24975:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790972713.860330:0:24975:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff888e2d0f0000) 00000020:00000080:2.0:1790972713.860355:0:24975:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:2.0:1790972713.860450:0:24975:0:(tgt_mount.c:153:server_get_mount()) get mount ffff888e3fa28800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790972713.860455:0:24975:0:(tgt_mount.c:187:server_put_mount()) put mount ffff888e3fa28800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790972713.860458:0:24975:0:(obd_mount.c:710:lustre_put_lsi()) put ffff888e3fa28800 3 00010000:00080000:2.0:1790972713.860492:0:24975:0:(ldlm_lib.c:102:import_set_conn()) imp ffff888d0785e000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.139@tcp at head 00000100:00100000:0.0:1790972713.862041:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397673216 00000100:00100000:0.0:1790972713.862052:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397673216 00000100:00100000:0.0:1790972713.862105:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790972713.862112:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3637:x1877970397673216:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1790972713.862137:0:22642:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 651 last 0 00000020:00000080:0.0:1790972713.862175:0:22642:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd61f4faa13a11c75 00000004:00100000:0.0:1790972713.862190:0:22642:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790972713.862222:0:22642:0:(import.c:65:import_set_state_nolock()) ffff888d089c5800 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1790972713.865760:0:24975:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1790972713.868761:0:24975:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1790972713.868831:0:24975:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790972713.868844:0:24975:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd61f4faa13a11c7c 00000100:00080000:2.0:1790972713.868868:0:24975:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790972713.868879:0:24975:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff888d0785e000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:2.0:1790972713.868915:0:24975:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3f74f800 x1877970397673344/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790972713.868933:0:24975:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1790972713.870339:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05488000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1877970397673216:12345-0@lo:38:llog_process_th.0 Request processed in 8218us (13577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972713.870352:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790972713.871793:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3f74fb80 x1877970397673216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790972723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972713.871808:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790972713.871818:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1790972713.871825:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790972713.871831:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790972713.871834:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d07a95800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790972713.871841:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3637:1877970397673216:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790972713.871896:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1877970397673344:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790972713.871961:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972713.872132:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397673344 00000100:00100000:3.0:1790972713.872140:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397673344 00000100:00100000:3.0:1790972713.872178:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790972713.872185:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3637:x1877970397673344:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790972713.872213:0:22644:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 651 last 0 00000020:00000080:3.0:1790972713.872247:0:22644:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd61f4faa13a11c83 00000004:00100000:3.0:1790972713.872261:0:22644:0:(mdt_handler.c:7299:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790972713.872291:0:22644:0:(import.c:65:import_set_state_nolock()) ffff888d05daf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790972713.872350:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1877970397673344:12345-0@lo:38:llog_process_th.0 Request processed in 163us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972713.872372:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1790972713.872634:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff888e3f74f800 x1877970397673344/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790972723 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972713.872652:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790972713.872658:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:1.0:1790972713.872699:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1790972713.872702:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1790972713.872705:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d0785e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790972713.872710:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3637:1877970397673344:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1790972713.872878:0:24975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:0.0:1790972713.876168:0:24961:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1790972713.876209:0:24961:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790972713.876233:0:24961:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43a00/0xd61f4faa13a11c52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11c59 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.876246:0:24961:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3ad43a00/0xd61f4faa13a11c52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11c59 expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790972713.876300:0:24961:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790972713.876302:0:24961:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790972713.876303:0:24961:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790972713.876304:0:24961:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790972713.876305:0:24961:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790972713.876307:0:24961:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790972713.876308:0:24961:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790972713.876310:0:24961:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790972713.876311:0:24961:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790972713.876315:0:24961:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1790972713.876317:0:24961:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790972713.876319:0:24961:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790972713.876320:0:24961:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790972713.876321:0:24961:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790972713.876321:0:24961:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790972713.876322:0:24961:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790972713.876323:0:24961:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790972713.876325:0:24961:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790972713.876326:0:24961:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790972713.876350:0:24961:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790972713.876374:0:24961:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397673472:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790972713.876438:0:24961:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.876481:0:24961:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06c3c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972713.878537:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397673472 00000100:00100000:3.0:1790972713.878549:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397673472 00000100:00100000:3.0:1790972713.878606:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790972713.878615:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397673472:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790972713.878645:0:22637:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1790972713.879434:0:22637:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1790972713.887528:0:22637:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790972713.887573:0:22637:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790972713.888178:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a747050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:24961:x1877970397673472:12345-0@lo:253:mount.lustre.0 Request processed in 9558us (11733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972713.888192:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790972713.888453:0:24961:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:24961:1877970397673472:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790972713.888468:0:24961:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1790972713.888471:0:24961:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790972713.888472:0:24961:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1790972713.888474:0:24961:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790972713.888475:0:24961:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790972713.888476:0:24961:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790972713.888478:0:24961:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790972713.888479:0:24961:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790972713.888481:0:24961:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790972713.888483:0:24961:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790972713.888495:0:24961:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1790972713.890481:0:24961:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 20000000:01000000:0.0:1790972713.894049:0:22658:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790972713.894067:0:22658:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790972713.894089:0:22658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894110:0:22658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e3ad42a00/0xd61f4faa13a11b17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11b10 expref: 23 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894118:0:22658:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11b1e expref: 23 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894126:0:22658:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894166:0:22658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11b1e expref: 23 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894182:0:22658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11b25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11b1e expref: 23 pid: 22636 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972713.894196:0:22658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bf800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397673600:0@lo:104: 00000100:00100000:0.0:1790972713.894260:0:22658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790972713.894307:0:22658:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e3ad42a00/0xd61f4faa13a11b17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11b10 expref: 23 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894316:0:22658:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e3ad42a00/0xd61f4faa13a11b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11b10 expref: 23 pid: 22634 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972713.894337:0:22658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397673728:0@lo:104: 00000100:00100000:0.0:1790972713.894362:0:22658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.894379:0:22658:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06c3cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1790972713.894401:0:22625:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397673600 00000100:00100000:0.0:1790972713.894408:0:22625:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397673600 00000100:00100000:0.0:1790972713.894443:0:22625:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397673728 00000100:00100000:0.0:1790972713.894446:0:22625:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397673728 00000100:00100000:0.0:1790972713.894459:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790972713.894467:0:22625:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+4:22658:x1877970397673600:12345-0@lo:104: 00010000:00010000:0.0:1790972713.894479:0:22625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11b25 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894526:0:22625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790972713.894531:0:22625:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+4:22658:x1877970397673600:12345-0@lo:104: Request processed in 65us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972713.894538:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790972713.894554:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790972713.894560:0:22625:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+3:22658:x1877970397673728:12345-0@lo:104: 00010000:00010000:0.0:1790972713.894567:0:22625:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11b17 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894597:0:22625:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790972713.894602:0:22625:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+3:22658:x1877970397673728:12345-0@lo:104: Request processed in 43us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972713.894608:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1790972713.894626:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790972713.894631:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11b25 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894644:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3d3ccc00 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:0.0:1790972713.894648:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a11b25 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894657:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a11b25 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790972713.894687:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a11b25 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972713.894693:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790972713.894725:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11b25 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894733:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790972713.894751:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11b25 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894757:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3d3ccc00/0xd61f4faa13a11b1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11b25 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894769:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790972713.894771:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11b17 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894777:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3d3cd000 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:0.0:1790972713.894780:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a11b17 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894795:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a11b17 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790972713.894801:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a11b17 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790972713.894806:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790972713.894819:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11b17 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894824:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790972713.894838:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11b17 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894845:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3d3cd000/0xd61f4faa13a11b10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11b17 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.894862:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972713.894864:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972713.894865:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972713.894871:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790972713.894881:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397673856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790972713.894908:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.894945:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3638:1877970397673984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790972713.894966:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972713.894996:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397673856 00000100:00100000:0.0:1790972713.895000:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397673856 00010000:00010000:0.0:1790972713.895014:0:22627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11b25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11b1e expref: 24 pid: 22636 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972713.895041:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397673984 00000100:00100000:0.0:1790972713.895044:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397673984 00010000:00010000:0.0:1790972713.895055:0:22627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e3ad42a00/0xd61f4faa13a11b17 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11b10 expref: 25 pid: 22634 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972713.895084:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790972713.895090:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+25:3641:x1877970397673856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972713.895100:0:22627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972713.895104:0:22627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11b25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11b1e expref: 25 pid: 22636 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895113:0:22627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11b25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11b1e expref: 25 pid: 22636 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895126:0:22627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790972713.895154:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa01880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+25:3641:x1877970397673856:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972713.895160:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790972713.895171:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790972713.895176:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:3638:x1877970397673984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972713.895183:0:22627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972713.895188:0:22627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e3ad42a00/0xd61f4faa13a11b17 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11b10 expref: 24 pid: 22634 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895194:0:22627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e3ad42a00/0xd61f4faa13a11b17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11b10 expref: 24 pid: 22634 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895205:0:22627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895218:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790972713.895230:0:22627:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005897832s 00010000:00010000:0.0:1790972713.895234:0:22627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895241:0:22627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895248:0:22627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895255:0:22627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895260:0:22627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdca00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972713.895264:0:22627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895271:0:22627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895278:0:22627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895287:0:22627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790972713.895313:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:3638:x1877970397673984:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972713.895318:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790972713.895359:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d521500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3638:1877970397673984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790972713.895384:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397673856:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972713.895404:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e15085e00/0xd61f4faa13a11b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11b1e expref: 23 pid: 22636 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972713.895414:0:22658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bf800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397673600:0@lo:104: 00010000:00010000:0.0:1790972713.895423:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3ad42a00/0xd61f4faa13a11b17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11b10 expref: 22 pid: 22634 timeout: 751 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972713.895431:0:22658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bd500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22658:1877970397673728:0@lo:104: 00010000:00010000:0.0:1790972713.895444:0:22658:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895453:0:22658:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895459:0:22658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972713.895465:0:22658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11c8a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1790972713.897051:0:24961:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1790972713.897069:0:24961:0:(lfsck_lib.c:3084:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1790972713.897107:0:24961:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790972713.897146:0:24961:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.139@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790972713.897165:0:24961:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1790972713.897185:0:24961:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1790972713.897983:0:24961:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790972713.898220:0:24961:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790972714.231118:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790972714.231144:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397674112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790972714.231221:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972714.231346:0:24151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397674112 00000100:00100000:3.0:1790972714.231354:0:24151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397674112 00000100:00100000:3.0:1790972714.231407:0:24151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790972714.231417:0:24151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397674112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1790972714.231446:0:24151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790972714.231509:0:24151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05489f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397674112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972714.231516:0:24151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790972714.231649:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d571180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397674112:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790972714.554838:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1790972714.708643:0:25027:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1790972714.712438:0:25027:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1790972715.253337:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397674240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1790972715.253410:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972715.255706:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790972715.255723:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397674368:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790972715.255789:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972715.264687:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397674240 00000100:00100000:2.0:1790972715.264702:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397674240 00000100:00100000:2.0:1790972715.264772:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397674368 00000100:00100000:2.0:1790972715.264776:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397674368 00000100:00100000:2.0:1790972715.264797:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790972715.264805:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397674240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790972715.264852:0:22648:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790972715.265092:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397674240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 286us (11680us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972715.265101:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790972715.265119:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790972715.265125:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397674368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790972715.265142:0:22648:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790972715.265171:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397674368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (9382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972715.265190:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790972715.265242:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397674368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1790972715.265257:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397674240:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790972715.572900:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790972715.637583:0:22639:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790972715.637592:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff888e02880000 from 14 10000000:01000000:1.0:1790972715.637597:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790972715.637641:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e1d1ebc00/0xd61f4faa13a11c91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972715.637654:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e1d1ebc00/0xd61f4faa13a11c91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972715.637681:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e1d1ebc00/0xd61f4faa13a11c91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972715.637707:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397674496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790972715.637773:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972715.637836:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06adc840 going to sleep for 11 seconds 00000100:00100000:3.0:1790972715.638536:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397674496 00000100:00100000:3.0:1790972715.638545:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397674496 00000100:00100000:3.0:1790972715.638609:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790972715.638619:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:22639:x1877970397674496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790972715.638634:0:22636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972715.638647:0:22636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11c98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11c91 expref: -99 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972715.638695:0:22636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11c91 expref: 23 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972715.638706:0:22636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3ad43200/0xd61f4faa13a11c98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11c91 expref: 23 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972715.638715:0:22636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad43200, rc 0) 00000100:00100000:3.0:1790972715.638765:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a745450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:22639:x1877970397674496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972715.638772:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1790972715.638928:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397674496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790972715.638953:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e1d1ebc00/0xd61f4faa13a11c91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11c98 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972715.638962:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e1d1ebc00/0xd61f4faa13a11c91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11c98 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972715.639014:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397674624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790972715.639058:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972715.639087:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06adc840 going to sleep for 11 seconds 00000100:00100000:3.0:1790972715.639133:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397674624 00000100:00100000:3.0:1790972715.639138:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397674624 00000100:00100000:3.0:1790972715.639170:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790972715.639176:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:22639:x1877970397674624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1790972715.639190:0:22637:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1790972715.639205:0:22637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1790972715.639207:0:22637:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1790972715.639269:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a745050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:22639:x1877970397674624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972715.639277:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790972715.639336:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397674624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790972715.639387:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790972715.639394:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e1d1ebc00/0xd61f4faa13a11c91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11c98 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972715.639401:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e1d1ebc00/0xd61f4faa13a11c91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11c98 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790972715.639410:0:22639:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790972715.639412:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff888e2d3c6000 from 14 10000000:01000000:1.0:1790972715.639414:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790972715.639431:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e1d1ea600/0xd61f4faa13a11c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972715.639439:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e1d1ea600/0xd61f4faa13a11c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972715.639459:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e1d1ea600/0xd61f4faa13a11c9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972715.639483:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397674752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790972715.639508:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972715.639529:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06adc840 going to sleep for 11 seconds 00000100:00100000:1.0:1790972715.639542:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397674752 00000100:00100000:1.0:1790972715.639546:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397674752 00000100:00100000:1.0:1790972715.639568:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790972715.639574:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:22639:x1877970397674752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790972715.639581:0:22636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972715.639589:0:22636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e1d1ea200/0xd61f4faa13a11ca6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11c9f expref: -99 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972715.639603:0:22636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e1d1ea200/0xd61f4faa13a11ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11c9f expref: 24 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972715.639612:0:22636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e1d1ea200/0xd61f4faa13a11ca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11c9f expref: 24 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972715.639618:0:22636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1ea200, rc 0) 00000100:00100000:1.0:1790972715.639644:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a744050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:22639:x1877970397674752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972715.639650:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790972715.639702:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397674752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790972715.639713:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e1d1ea600/0xd61f4faa13a11c9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11ca6 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972715.639720:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e1d1ea600/0xd61f4faa13a11c9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11ca6 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972715.639762:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397674880:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1790972715.639925:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972715.639944:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06adc840 going to sleep for 11 seconds 00000100:00100000:1.0:1790972715.639955:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397674880 00000100:00100000:1.0:1790972715.639958:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397674880 00000100:00100000:1.0:1790972715.639976:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790972715.639982:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:22639:x1877970397674880:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1790972715.639991:0:22637:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790972715.640000:0:22637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790972715.640003:0:22637:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1790972715.640066:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a747450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:22639:x1877970397674880:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 84us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972715.640073:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1790972715.640101:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397674880:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790972715.640138:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790972715.640144:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e1d1ea600/0xd61f4faa13a11c9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11ca6 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972715.640152:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e1d1ea600/0xd61f4faa13a11c9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11ca6 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790972716.150281:0:23395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790972716.596787:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972717.622165:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972718.325977:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790972718.326010:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397675008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790972718.326092:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972718.326585:0:24151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397675008 00000100:00100000:1.0:1790972718.326595:0:24151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397675008 00000100:00100000:1.0:1790972718.326696:0:24151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790972718.326707:0:24151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397675008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790972718.326749:0:24151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790972718.326818:0:24151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d572d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397675008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972718.326826:0:24151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790972718.326873:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397675008:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790972718.327237:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1790972718.648143:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790972719.352236:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397675136:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790972719.352309:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972719.352403:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397675136 00000100:00100000:1.0:1790972719.352411:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397675136 00000100:00100000:1.0:1790972719.352466:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790972719.352475:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397675136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790972719.352498:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790972719.352542:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397675136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972719.352549:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1790972719.352576:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790972719.352612:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397675136:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1790972719.356057:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972719.356062:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790972719.356066:0:38:0:(import.c:65:import_set_state_nolock()) ffff888d07d6a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972719.356074:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 651 00000100:00080000:0.0:1790972719.356079:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790972719.356089:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff888d07d6a000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972719.356103:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397675520:0@lo:400:kworker.0 00000100:00100000:0.0:1790972719.356163:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972719.356226:0:24693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397675520 00000100:00100000:0.0:1790972719.356234:0:24693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397675520 00000100:00100000:0.0:1790972719.356279:0:24693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790972719.356288:0:24693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397675520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972719.356338:0:24693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397675520:12345-0@lo:400:kworker.0 Request processed in 51us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972719.356345:0:24693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790972719.356600:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397675264:0@lo:400:kworker.0 00000100:00100000:2.0:1790972719.356637:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972719.356675:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790972719.356680:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397675392:0@lo:400:kworker.0 00000100:00100000:2.0:1790972719.356703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972719.356724:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397675264 00000100:00100000:2.0:1790972719.356727:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397675264 00000100:00100000:2.0:1790972719.356749:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790972719.356754:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:3640:x1877970397675264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972719.356786:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a746050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:3640:x1877970397675264:12345-0@lo:400:kworker.0 Request processed in 32us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972719.356792:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1790972719.356816:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397675392 00000100:00100000:2.0:1790972719.356818:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397675392 00000100:00100000:2.0:1790972719.356838:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790972719.356843:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397675392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972719.356871:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397675392:12345-0@lo:400:kworker.0 Request processed in 28us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972719.356876:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790972719.356901:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397675392:0@lo:400:kworker.0 00000100:00100000:2.0:1790972719.356920:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397675264:0@lo:400:kworker.0 00000100:00100000:0.0:1790972719.357628:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397675520:0@lo:400:kworker.0 00000100:00100000:0.0:1790972719.357683:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa02680 x1877970397675648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1790972719.357732:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877970397675776:0@lo:400:kworker.0 00000100:00100000:0.0:1790972719.357770:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972719.357803:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397675776 00000100:00100000:0.0:1790972719.357808:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397675776 00000100:00100000:0.0:1790972719.357847:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790972719.357853:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877970397675776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972719.357894:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877970397675776:12345-0@lo:400:kworker.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972719.357901:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1790972719.357931:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3fa01f80 x1877970397675776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972719.357942:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877970397675776:0@lo:400:kworker.0 00000100:00080000:0.0:1790972719.357965:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790972719.357969:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1790972719.357972:0:38:0:(import.c:65:import_set_state_nolock()) ffff888d05dfd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1790972719.357976:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 651 00000100:00080000:0.0:1790972719.357979:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1790972719.357986:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff888d05dfd000 using connection 192.168.203.139@tcp/0@lo 00000100:00100000:0.0:1790972719.357998:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff888e3fa00380 x1877970397676032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790972719.358234:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397675904:0@lo:400:kworker.0 00000100:00100000:2.0:1790972719.358265:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972719.358284:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790972719.358290:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877970397676160:0@lo:400:kworker.0 00000100:00100000:2.0:1790972719.358310:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972719.358631:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397675648:0@lo:8:kworker.0 00000100:00100000:3.0:1790972719.358683:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972719.358711:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397676032:0@lo:8:kworker.0 00000100:00100000:3.0:1790972719.358736:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972719.358771:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397676160 00000100:00100000:3.0:1790972719.358775:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397676160 00000100:00100000:3.0:1790972719.358808:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790972719.358815:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877970397676160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972719.358853:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877970397676160:12345-0@lo:400:kworker.0 Request processed in 39us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972719.358860:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790972719.358879:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397675904 00000100:00100000:3.0:1790972719.358882:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397675904 00000100:00100000:3.0:1790972719.358903:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790972719.358909:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397675904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972719.358940:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397675904:12345-0@lo:400:kworker.0 Request processed in 31us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972719.358945:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1790972719.358973:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3fa00000 x1877970397676160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972719.358983:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877970397676160:0@lo:400:kworker.0 00000100:00100000:3.0:1790972719.358994:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397675904:0@lo:400:kworker.0 00000100:00100000:2.0:1790972719.359091:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397675648 00000100:00100000:2.0:1790972719.359095:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397675648 00000100:00100000:2.0:1790972719.359122:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397676032 00000100:00100000:2.0:1790972719.359125:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397676032 00000100:00100000:2.0:1790972719.359141:0:24147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790972719.359145:0:24147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3637:x1877970397675648:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790972719.359173:0:24147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:2.0:1790972719.359202:0:24147:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd61f4faa13a11cad 00002000:00100000:2.0:1790972719.359218:0:24147:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff888d0785f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790972719.359222:0:24147:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1790972719.359225:0:24147:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1790972719.359541:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790972719.359548:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3637:x1877970397676032:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1790972719.359565:0:24149:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 657 last 0 00000020:00000080:1.0:1790972719.359582:0:24149:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd61f4faa13a11cb4 00002000:00100000:1.0:1790972719.359587:0:24149:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff888d07a91000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113b02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1790972719.359591:0:24149:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1790972719.359593:0:24149:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1790972719.359623:0:24149:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1790972719.359645:0:24149:0:(import.c:65:import_set_state_nolock()) ffff888d07a92000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790972719.359714:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d571f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3637:x1877970397676032:12345-0@lo:8:kworker.0 Request processed in 164us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972719.359721:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790972719.360679:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877970397676288:0@lo:400:kworker.0 00000100:00100000:0.0:1790972719.360734:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972719.360777:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397676288 00000100:00100000:0.0:1790972719.360784:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397676288 00000100:00100000:0.0:1790972719.360828:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790972719.360836:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877970397676288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972719.360877:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1877970397676288:12345-0@lo:400:kworker.0 Request processed in 42us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972719.360883:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1790972719.360910:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790972719.360938:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3fa02a00 x1877970397676288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972719.360951:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3638:1877970397676288:0@lo:400:kworker.0 00000100:00100000:0.0:1790972719.360995:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877970397676416:0@lo:400:kworker.0 00000100:00100000:0.0:1790972719.361031:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972719.361559:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397676416 00000100:00100000:3.0:1790972719.361565:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397676416 00000100:00100000:3.0:1790972719.361605:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790972719.361612:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3fa00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877970397676416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972719.361657:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3fa00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877970397676416:12345-0@lo:400:kworker.0 Request processed in 47us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972719.361686:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1790972719.361701:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1790972719.361722:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3fa02a00 x1877970397676416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972719.361731:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877970397676416:0@lo:400:kworker.0 00000100:00100000:3.0:1790972719.361750:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877970397676672:0@lo:400:kworker.0 00000100:00100000:3.0:1790972719.361781:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972719.361803:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790972719.361808:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1877970397676544:0@lo:400:kworker.0 00000100:00100000:3.0:1790972719.361831:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972719.361853:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397676672 00000100:00100000:3.0:1790972719.361856:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397676672 00000100:00100000:3.0:1790972719.361879:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397676544 00000100:00100000:3.0:1790972719.361882:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397676544 00000100:00100000:3.0:1790972719.361899:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790972719.361905:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877970397676672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972719.361940:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d572300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877970397676672:12345-0@lo:400:kworker.0 Request processed in 34us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972719.361946:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790972719.361957:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790972719.361971:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877970397676544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972719.362001:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d571500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877970397676544:12345-0@lo:400:kworker.0 Request processed in 31us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972719.362007:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00002000:00080000:2.0:1790972719.362123:0:24147:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790972719.362152:0:24147:0:(import.c:65:import_set_state_nolock()) ffff888d0785c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790972719.362192:0:24147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d570e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3637:x1877970397675648:12345-0@lo:8:kworker.0 Request processed in 3045us (3507us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972719.362199:0:24147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1790972719.365735:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3fa02680 x1877970397675648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790972744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972719.365751:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790972719.365762:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1790972719.365781:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790972719.365788:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790972719.365792:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d07d6a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790972719.365817:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790972719.365825:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3637:1877970397675648:0@lo:8:kworker.0 00010000:00080000:2.0:1790972719.365842:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3fa00380 x1877970397676032/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790972744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972719.365850:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790972719.365854:0:3637:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1790972719.365858:0:3637:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790972719.365861:0:3637:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790972719.365862:0:3637:0:(import.c:65:import_set_state_nolock()) ffff888d05dfd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790972719.365871:0:3637:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790972719.365874:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3637:1877970397676032:0@lo:8:kworker.0 00000004:00080000:2.0:1790972719.365946:0:23386:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1790972719.365972:0:23386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f776a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23386:1877970397676928:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1790972719.366043:0:23386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972719.366074:0:23386:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d62ecc0 going to sleep for 11 seconds 00000004:00080000:2.0:1790972719.366091:0:23385:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790972719.366186:0:23385:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 657393523406ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790972719.366192:0:23385:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1790972719.366217:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397676800:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790972719.366246:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972719.366447:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397676800 00000100:00100000:2.0:1790972719.366455:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397676800 00000100:00100000:2.0:1790972719.366502:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790972719.366511:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1877970397676800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1790972719.366544:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790972719.366589:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f774a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1877970397676800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972719.366595:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1790972719.366629:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3f74d500 x1877970397676800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790972735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972719.366644:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f74d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397676800:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1790972719.366701:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790972719.366706:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790972719.366708:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1790972719.366731:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3d5bd500 x1877970397676544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972719.366741:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1877970397676544:0@lo:400:kworker.0 00010000:00080000:2.0:1790972719.366755:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3d5bf800 x1877970397676672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972719.366763:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877970397676672:0@lo:400:kworker.0 00000004:00080000:2.0:1790972719.366791:0:22668:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790972719.366838:0:22668:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 657394175929ns, next at 0ns, rc = 0 00080000:00080000:2.0:1790972719.366844:0:22668:0:(osd_handler.c:2856:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1790972719.367043:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397676928 00000100:00100000:1.0:1790972719.367048:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397676928 00000100:00100000:1.0:1790972719.367075:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790972719.367082:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23386:x1877970397676928:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1790972719.371905:0:22669:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:0.0:1790972719.372553:0:22669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22669:1877970397677184:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1790972719.372622:0:22669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972719.372654:0:22669:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3aca3300 going to sleep for 11 seconds 00000100:00100000:0.0:1790972719.372690:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d5bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397677056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790972719.372717:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972719.372759:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397677056 00000100:00100000:0.0:1790972719.372767:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397677056 00000100:00100000:0.0:1790972719.372819:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790972719.372828:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1877970397677056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790972719.372849:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790972719.372891:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d521500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3639:x1877970397677056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972719.372899:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1790972719.372922:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790972719.372959:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3d5bf480 x1877970397677056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790972735 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972719.372977:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397677056:0@lo:13:osp-pre-1-0.0 00002000:00080000:2.0:1790972719.374253:0:24149:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1790972719.374265:0:24149:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1790972719.374348:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f774380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23386:x1877970397676928:12345-0@lo:7:osp-pre-1-1.0 Request processed in 7264us (8302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972719.374359:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790972719.375611:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397677184 00000100:00100000:2.0:1790972719.375631:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397677184 00000100:00100000:2.0:1790972719.375692:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790972719.375702:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22669:x1877970397677184:12345-0@lo:5:osp-pre-1-0.0 00010000:00080000:2.0:1790972719.375983:0:23386:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3f776a00 x1877970397676928/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790972735 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972719.375999:0:23386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f776a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23386:1877970397676928:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1790972719.376013:0:23386:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1790972719.376063:0:23386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f776a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23386:1877970397677312:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1790972719.376115:0:23386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972719.376140:0:23386:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d62ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790972719.376156:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397677312 00000100:00100000:2.0:1790972719.376160:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397677312 00000100:00100000:2.0:1790972719.376180:0:24147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790972719.376187:0:24147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23386:x1877970397677312:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1790972719.376217:0:24147:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1790972719.376252:0:24147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f774000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23386:x1877970397677312:12345-0@lo:5:osp-pre-1-1.0 Request processed in 65us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972719.376258:0:24147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1790972719.376317:0:23386:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3f776a00 x1877970397677312/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790972735 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972719.376326:0:23386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f776a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23386:1877970397677312:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1790972719.376334:0:23386:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1790972719.376357:0:23386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f776a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23386:1877970397677440:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1790972719.376377:0:23386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972719.380283:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397677440 00000100:00100000:2.0:1790972719.380294:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397677440 00000100:00100000:2.0:1790972719.380340:0:24147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790972719.380350:0:24147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23386:x1877970397677440:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1790972719.381309:0:24147:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000100:00100000:1.0:1790972719.384708:0:23386:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3d62ecc0 going to sleep for 11 seconds 00000004:00080000:3.0:1790972719.385303:0:22622:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1790972719.385739:0:23374:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:2.0:1790972719.387547:0:24149:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1790972719.387560:0:24149:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:2.0:1790972719.387566:0:24149:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00002000:00010000:3.0:1790972719.416882:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790972719.416893:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090091982/0xd61f4faa13a11cbb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.416911:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1790972719.416915:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790972719.416921:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090091982/0xd61f4faa13a11cbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.416949:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090091982/0xd61f4faa13a11cbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.416959:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090091982/0xd61f4faa13a11cbb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.416967:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090091982/0xd61f4faa13a11cbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.416989:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790972719.417323:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972719.417330:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090091982/0xd61f4faa13a11cbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.417338:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad42a00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972719.417342:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090091982/0xd61f4faa13a11cbb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.417350:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090091982/0xd61f4faa13a11cbb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.417367:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090091982/0xd61f4faa13a11cbb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.417373:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090091982/0xd61f4faa13a11cbb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.417405:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972719.417406:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972719.417415:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790972719.419239:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790972719.419253:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11cc2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419269:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1790972719.419273:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790972719.419279:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11cc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419291:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11cc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419302:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11cc2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419309:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11cc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419327:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790972719.419739:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790972719.419745:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11cc9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419754:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1790972719.419757:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790972719.419761:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11cc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419783:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11cc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419790:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11cc9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419797:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11cc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419813:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790972719.419823:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790972719.419828:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11cc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419835:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3d3cd400 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972719.419839:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11cc2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419848:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11cc2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419862:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11cc2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419870:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11cc2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419892:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972719.419895:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11cc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419901:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3d3cc400 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972719.419904:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11cc9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419912:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11cc9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419922:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11cc9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419979:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11cc9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.419994:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972719.419996:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972719.419998:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.420262:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972719.421266:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972719.421274:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11cd0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.421287:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1790972719.421291:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972719.421295:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11cd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.421307:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11cd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.421315:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11cd0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.421322:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11cd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.421345:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972719.421683:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972719.421690:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11cd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.421705:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eaa00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.421709:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11cd0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.421717:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11cd0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.421731:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11cd0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.421739:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11cd0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.421760:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.421761:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.421763:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790972719.422046:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790972719.422052:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037f48d67/0xd61f4faa13a11cd7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.422062:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1790972719.422065:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790972719.422070:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037f48d67/0xd61f4faa13a11cd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.422079:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037f48d67/0xd61f4faa13a11cd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.422092:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037f48d67/0xd61f4faa13a11cd7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.422100:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037f48d67/0xd61f4faa13a11cd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.422121:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790972719.422594:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790972719.422600:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000187270ce/0xd61f4faa13a11cde lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.422608:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1790972719.422612:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790972719.422616:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000187270ce/0xd61f4faa13a11cde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.422625:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000187270ce/0xd61f4faa13a11cde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.422633:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000187270ce/0xd61f4faa13a11cde lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.422640:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000187270ce/0xd61f4faa13a11cde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.422692:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1790972719.423032:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790972719.423038:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfdfccba/0xd61f4faa13a11ce5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.423046:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1790972719.423048:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790972719.423052:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bfdfccba/0xd61f4faa13a11ce5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.423060:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bfdfccba/0xd61f4faa13a11ce5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.423067:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bfdfccba/0xd61f4faa13a11ce5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.423074:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bfdfccba/0xd61f4faa13a11ce5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.423082:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1790972719.423462:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790972719.423470:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037f48d67/0xd61f4faa13a11cd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423478:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad42600 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:1.0:1790972719.423482:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037f48d67/0xd61f4faa13a11cd7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423490:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037f48d67/0xd61f4faa13a11cd7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423505:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037f48d67/0xd61f4faa13a11cd7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423512:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037f48d67/0xd61f4faa13a11cd7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423531:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790972719.423535:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000187270ce/0xd61f4faa13a11cde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423542:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad42e00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:1.0:1790972719.423546:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000187270ce/0xd61f4faa13a11cde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423553:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000187270ce/0xd61f4faa13a11cde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423576:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000187270ce/0xd61f4faa13a11cde lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423583:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000187270ce/0xd61f4faa13a11cde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423596:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790972719.423599:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bfdfccba/0xd61f4faa13a11ce5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423606:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad43000 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:1.0:1790972719.423609:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfdfccba/0xd61f4faa13a11ce5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423616:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bfdfccba/0xd61f4faa13a11ce5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423625:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bfdfccba/0xd61f4faa13a11ce5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423632:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bfdfccba/0xd61f4faa13a11ce5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.423643:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972719.423644:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972719.423652:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972719.424324:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790972719.424610:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790972719.424618:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb636a4f/0xd61f4faa13a11cec lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.424633:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1790972719.424644:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790972719.424650:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb636a4f/0xd61f4faa13a11cec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.424680:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb636a4f/0xd61f4faa13a11cec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.424690:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb636a4f/0xd61f4faa13a11cec lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.424698:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb636a4f/0xd61f4faa13a11cec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.424714:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972719.424724:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972719.424729:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb636a4f/0xd61f4faa13a11cec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.424735:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e09fea200 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.424739:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb636a4f/0xd61f4faa13a11cec lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.424746:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb636a4f/0xd61f4faa13a11cec lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.424759:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb636a4f/0xd61f4faa13a11cec lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.424776:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb636a4f/0xd61f4faa13a11cec lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.424794:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.424796:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.424798:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790972719.426617:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790972719.426629:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cf3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.426646:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1790972719.426651:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790972719.426657:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.426687:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.426697:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cf3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.426705:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.426721:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790972719.427096:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972719.427104:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.427112:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e09feba00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972719.427122:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cf3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.427132:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cf3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.427146:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cf3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.427153:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cf3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.427172:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972719.427174:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972719.427176:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790972719.437447:0:24962:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1790972719.437475:0:24962:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1790972719.437481:0:24962:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1790972719.437725:0:24147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f776300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23386:x1877970397677440:12345-0@lo:5:osp-pre-1-1.0 Request processed in 57372us (61341us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1790972719.437744:0:24147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790972719.438599:0:23386:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1790972719.438610:0:23386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f776a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23386:1877970397677440:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1790972719.438627:0:23386:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1790972719.438703:0:23386:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f776a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23386:1877970397677568:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1790972719.438749:0:23386:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972719.438779:0:23386:0:(client.c:2716:ptlrpc_set_wait()) set ffff888d06c3c240 going to sleep for 11 seconds 00000100:00100000:3.0:1790972719.442557:0:22653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397677568 00000100:00100000:3.0:1790972719.442575:0:22653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397677568 00000100:00100000:3.0:1790972719.442633:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790972719.442645:0:22653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23386:x1877970397677568:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1790972719.442756:0:22653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f777100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23386:x1877970397677568:12345-0@lo:900:osp-pre-1-1.0 Request processed in 113us (4006us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972719.442763:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790972719.442808:0:23386:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3f776a00 x1877970397677568/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1790972735 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790972719.442821:0:23386:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f776a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23386:1877970397677568:0@lo:900:osp-pre-1-1.0 00002000:00010000:3.0:1790972719.442953:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790972719.442962:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cfa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.442979:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1790972719.442983:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790972719.442989:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.443004:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.443014:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cfa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.443049:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.443067:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972719.443080:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972719.443086:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.443095:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e09feba00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.443100:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cfa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.443111:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cfa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.443130:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cfa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.443138:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002525c91c/0xd61f4faa13a11cfa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.443160:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.443162:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.443164:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790972719.446147:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790972719.446172:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5839d31/0xd61f4faa13a11d01 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446188:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1790972719.446194:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790972719.446200:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5839d31/0xd61f4faa13a11d01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446215:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5839d31/0xd61f4faa13a11d01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446225:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5839d31/0xd61f4faa13a11d01 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446232:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5839d31/0xd61f4faa13a11d01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446258:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790972719.446832:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790972719.446838:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026238736/0xd61f4faa13a11d08 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446848:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1790972719.446851:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790972719.446855:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026238736/0xd61f4faa13a11d08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446865:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026238736/0xd61f4faa13a11d08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446883:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026238736/0xd61f4faa13a11d08 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446889:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026238736/0xd61f4faa13a11d08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446905:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790972719.446914:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790972719.446920:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5839d31/0xd61f4faa13a11d01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446926:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e15085e00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.446941:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5839d31/0xd61f4faa13a11d01 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446950:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5839d31/0xd61f4faa13a11d01 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446966:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5839d31/0xd61f4faa13a11d01 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446973:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5839d31/0xd61f4faa13a11d01 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.446992:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972719.447001:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026238736/0xd61f4faa13a11d08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447007:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e15085a00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.447010:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026238736/0xd61f4faa13a11d08 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447028:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026238736/0xd61f4faa13a11d08 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447039:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026238736/0xd61f4faa13a11d08 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447045:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026238736/0xd61f4faa13a11d08 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447057:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.447059:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.447060:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790972719.447479:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790972719.447485:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0f38d79/0xd61f4faa13a11d0f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447494:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1790972719.447498:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790972719.447502:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0f38d79/0xd61f4faa13a11d0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447524:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0f38d79/0xd61f4faa13a11d0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447533:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0f38d79/0xd61f4faa13a11d0f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447541:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0f38d79/0xd61f4faa13a11d0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447556:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972719.447564:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972719.447567:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0f38d79/0xd61f4faa13a11d0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447573:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb7800 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.447576:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0f38d79/0xd61f4faa13a11d0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447584:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0f38d79/0xd61f4faa13a11d0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447594:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0f38d79/0xd61f4faa13a11d0f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447601:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0f38d79/0xd61f4faa13a11d0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447620:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.447622:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.447623:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790972719.447908:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1790972719.447914:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f933c722/0xd61f4faa13a11d16 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.447922:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=657s v=(0 0) 00010000:00010000:3.0:1790972719.447925:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790972719.448060:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.448096:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f933c722/0xd61f4faa13a11d16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.448108:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f933c722/0xd61f4faa13a11d16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.448116:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f933c722/0xd61f4faa13a11d16 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.448123:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f933c722/0xd61f4faa13a11d16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.448568:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790972719.449263:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972719.449271:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a11d1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.449284:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1790972719.449287:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972719.449292:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a11d1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.449303:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a11d1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.449311:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a11d1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.449318:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a11d1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.458906:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790972719.458941:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f933c722/0xd61f4faa13a11d16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.458954:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb6a00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972719.458958:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f933c722/0xd61f4faa13a11d16 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.458969:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f933c722/0xd61f4faa13a11d16 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.458990:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f933c722/0xd61f4faa13a11d16 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.458997:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f933c722/0xd61f4faa13a11d16 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.459032:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972719.459037:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a11d1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.459043:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eba00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972719.459046:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a11d1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.459053:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a11d1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.459072:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a11d1d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.459080:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972719.459081:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972719.459084:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790972719.459215:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790972719.459223:0:24149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a11d1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790972719.459782:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972719.459788:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a2d368/0xd61f4faa13a11d24 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.459800:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1790972719.459810:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972719.459816:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a2d368/0xd61f4faa13a11d24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.459829:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a2d368/0xd61f4faa13a11d24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.459838:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a2d368/0xd61f4faa13a11d24 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.459845:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a2d368/0xd61f4faa13a11d24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.459862:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790972719.460181:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972719.460186:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cc8158e/0xd61f4faa13a11d2b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.460196:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1790972719.460199:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972719.460203:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cc8158e/0xd61f4faa13a11d2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.460212:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cc8158e/0xd61f4faa13a11d2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.460220:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cc8158e/0xd61f4faa13a11d2b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.460234:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cc8158e/0xd61f4faa13a11d2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.460242:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1790972719.460552:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972719.460558:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a11d32 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.460568:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1790972719.460571:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972719.460575:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a11d32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.460582:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a11d32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.460589:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a11d32 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.460595:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a11d32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.460603:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1790972719.460866:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790972719.460874:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a2d368/0xd61f4faa13a11d24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.460883:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1ea400 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972719.460887:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a2d368/0xd61f4faa13a11d24 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.460895:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a2d368/0xd61f4faa13a11d24 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.460913:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a2d368/0xd61f4faa13a11d24 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.460920:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a2d368/0xd61f4faa13a11d24 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.460956:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790972719.460960:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cc8158e/0xd61f4faa13a11d2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.460967:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eb400 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972719.460969:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cc8158e/0xd61f4faa13a11d2b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.460976:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cc8158e/0xd61f4faa13a11d2b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.460996:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cc8158e/0xd61f4faa13a11d2b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.461002:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cc8158e/0xd61f4faa13a11d2b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.461014:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790972719.461029:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a11d32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.461035:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eb800 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972719.461038:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a11d32 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.461045:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a11d32 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.461055:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a11d32 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.461061:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a11d32 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.461074:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972719.461076:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972719.461083:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972719.461205:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972719.461211:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11d39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.461225:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1790972719.461228:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972719.461232:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11d39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.461241:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11d39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.461249:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11d39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.461257:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11d39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.461280:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790972719.461604:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972719.461610:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11d39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.461619:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eac00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972719.461622:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11d39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.461630:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11d39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.461641:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11d39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.461653:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1c5ce7b/0xd61f4faa13a11d39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.461682:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972719.461684:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972719.461685:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972719.461809:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972719.461884:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972719.461889:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027bd86af/0xd61f4faa13a11d40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.461898:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1790972719.461901:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972719.461905:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000027bd86af/0xd61f4faa13a11d40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.461914:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000027bd86af/0xd61f4faa13a11d40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.462791:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000027bd86af/0xd61f4faa13a11d40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.462805:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000027bd86af/0xd61f4faa13a11d40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.468475:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1790972719.469235:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972719.469247:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007df9216a/0xd61f4faa13a11d47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469265:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1790972719.469269:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972719.469276:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007df9216a/0xd61f4faa13a11d47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469290:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007df9216a/0xd61f4faa13a11d47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469300:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007df9216a/0xd61f4faa13a11d47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469307:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007df9216a/0xd61f4faa13a11d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469322:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1790972719.469330:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790972719.469336:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000027bd86af/0xd61f4faa13a11d40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469343:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eb600 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972719.469348:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000027bd86af/0xd61f4faa13a11d40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469367:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000027bd86af/0xd61f4faa13a11d40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469396:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000027bd86af/0xd61f4faa13a11d40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469405:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000027bd86af/0xd61f4faa13a11d40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469428:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790972719.469432:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007df9216a/0xd61f4faa13a11d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469439:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc400 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972719.469442:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007df9216a/0xd61f4faa13a11d47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469449:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007df9216a/0xd61f4faa13a11d47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469459:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007df9216a/0xd61f4faa13a11d47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469465:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007df9216a/0xd61f4faa13a11d47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469489:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972719.469491:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972719.469492:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972719.469813:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972719.469819:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015fdde4d/0xd61f4faa13a11d4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469828:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1790972719.469831:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972719.469836:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000015fdde4d/0xd61f4faa13a11d4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469845:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000015fdde4d/0xd61f4faa13a11d4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469852:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000015fdde4d/0xd61f4faa13a11d4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469859:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000015fdde4d/0xd61f4faa13a11d4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469873:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790972719.469880:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790972719.469883:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000015fdde4d/0xd61f4faa13a11d4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469900:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdcc00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972719.469904:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000015fdde4d/0xd61f4faa13a11d4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469912:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000015fdde4d/0xd61f4faa13a11d4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469923:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000015fdde4d/0xd61f4faa13a11d4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.469992:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000015fdde4d/0xd61f4faa13a11d4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.470007:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972719.470009:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972719.470010:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972719.470477:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972719.470483:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f27b8906/0xd61f4faa13a11d55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.470492:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1790972719.470496:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972719.470500:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f27b8906/0xd61f4faa13a11d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.470509:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f27b8906/0xd61f4faa13a11d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.470523:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f27b8906/0xd61f4faa13a11d55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.470531:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f27b8906/0xd61f4faa13a11d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.470547:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790972719.470555:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790972719.470559:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f27b8906/0xd61f4faa13a11d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.470566:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdd800 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972719.470569:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f27b8906/0xd61f4faa13a11d55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.470577:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f27b8906/0xd61f4faa13a11d55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.470587:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f27b8906/0xd61f4faa13a11d55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.470594:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f27b8906/0xd61f4faa13a11d55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.470607:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972719.470614:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972719.470616:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972719.471004:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972719.471011:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be14cb8c/0xd61f4faa13a11d5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471030:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1790972719.471034:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972719.471038:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be14cb8c/0xd61f4faa13a11d5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471048:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be14cb8c/0xd61f4faa13a11d5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471056:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be14cb8c/0xd61f4faa13a11d5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471063:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be14cb8c/0xd61f4faa13a11d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471077:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790972719.471084:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790972719.471087:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be14cb8c/0xd61f4faa13a11d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471094:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bddc00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972719.471097:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be14cb8c/0xd61f4faa13a11d5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471114:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be14cb8c/0xd61f4faa13a11d5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471126:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be14cb8c/0xd61f4faa13a11d5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471133:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be14cb8c/0xd61f4faa13a11d5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471147:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972719.471149:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790972719.471151:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.471401:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1790972719.471504:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1790972719.471510:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040a50630/0xd61f4faa13a11d63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471519:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=657s v=(0 0) 00010000:00010000:0.0:1790972719.471522:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790972719.471526:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040a50630/0xd61f4faa13a11d63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471536:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040a50630/0xd61f4faa13a11d63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471544:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040a50630/0xd61f4faa13a11d63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471562:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040a50630/0xd61f4faa13a11d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972719.471613:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972719.472500:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972719.472511:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040a50630/0xd61f4faa13a11d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.472887:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdd000 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.472892:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040a50630/0xd61f4faa13a11d63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.472904:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040a50630/0xd61f4faa13a11d63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.472921:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040a50630/0xd61f4faa13a11d63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.472929:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040a50630/0xd61f4faa13a11d63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.472949:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.472951:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.472953:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972719.473112:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972719.473120:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004096d521/0xd61f4faa13a11d6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.473132:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1790972719.473135:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972719.473141:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004096d521/0xd61f4faa13a11d6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.473151:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004096d521/0xd61f4faa13a11d6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.473159:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004096d521/0xd61f4faa13a11d6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.473167:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004096d521/0xd61f4faa13a11d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.473193:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972719.473565:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972719.473571:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004096d521/0xd61f4faa13a11d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.473579:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1ea000 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.473583:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004096d521/0xd61f4faa13a11d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.473591:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004096d521/0xd61f4faa13a11d6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.473611:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004096d521/0xd61f4faa13a11d6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.473618:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004096d521/0xd61f4faa13a11d6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.473644:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.473646:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.473648:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972719.473813:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972719.473819:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000498b5273/0xd61f4faa13a11d71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.473829:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1790972719.473832:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972719.473836:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000498b5273/0xd61f4faa13a11d71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.473845:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000498b5273/0xd61f4faa13a11d71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.473853:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000498b5273/0xd61f4faa13a11d71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.473861:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000498b5273/0xd61f4faa13a11d71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.473911:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972719.473987:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972719.473992:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000498b5273/0xd61f4faa13a11d71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.474000:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eb000 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.474003:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000498b5273/0xd61f4faa13a11d71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.474011:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000498b5273/0xd61f4faa13a11d71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.474033:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000498b5273/0xd61f4faa13a11d71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.474040:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000498b5273/0xd61f4faa13a11d71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.474066:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.474068:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.474070:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972719.474601:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972719.474608:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044bd219f/0xd61f4faa13a11d78 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.474619:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1790972719.474623:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972719.474627:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044bd219f/0xd61f4faa13a11d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.474648:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044bd219f/0xd61f4faa13a11d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.474657:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044bd219f/0xd61f4faa13a11d78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.474691:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044bd219f/0xd61f4faa13a11d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.474706:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972719.474997:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972719.475003:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044bd219f/0xd61f4faa13a11d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.475011:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1ea800 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.475015:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044bd219f/0xd61f4faa13a11d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.475032:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044bd219f/0xd61f4faa13a11d78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.475045:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044bd219f/0xd61f4faa13a11d78 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.475052:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044bd219f/0xd61f4faa13a11d78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.475071:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.475073:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.475074:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790972719.475150:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1790972719.475156:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11d7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.475165:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=657s v=(0 0) 00010000:00010000:1.0:1790972719.475168:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972719.475172:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.475181:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.475189:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11d7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.475208:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972719.475253:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790972719.478493:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790972719.478508:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11d86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.478524:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1790972719.478529:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790972719.478535:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.478549:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.478559:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11d86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.478568:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11d86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.479736:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790972719.479747:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.479771:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eaa00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.479776:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11d7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.479785:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11d7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.479803:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11d7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.479812:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe9f7178/0xd61f4faa13a11d7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.479840:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972719.479844:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.479851:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3d3cc400 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.479855:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11d86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.479862:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11d86 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.479872:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11d86 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.479885:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.479887:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.479889:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.483716:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972719.483730:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1790972719.483740:0:24149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a8e7586/0xd61f4faa13a11d86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790972719.485290:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1790972719.485301:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11d8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.485316:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=657s v=(0 0) 00010000:00010000:2.0:1790972719.485326:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790972719.485332:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.485345:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.485355:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11d8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.485363:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972719.485383:0:24149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790972719.485478:0:22630:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972719.485485:0:22630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.485493:0:22630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3d3cd400 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:3.0:1790972719.485497:0:22630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11d8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.485507:0:22630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11d8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.485524:0:22630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11d8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.485531:0:22630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019ad0449/0xd61f4faa13a11d8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972719.485546:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.485548:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972719.485550:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1790972719.486134:0:24149:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1790972719.486242:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22669:x1877970397677184:12345-0@lo:5:osp-pre-1-0.0 Request processed in 110538us (113617us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972719.486259:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790972719.486349:0:22669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d5bf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22669:1877970397677184:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1790972719.486362:0:22669:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:1.0:1790972719.486405:0:22669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22669:1877970397677696:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1790972719.486440:0:22669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972719.486471:0:22669:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3ac82e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790972719.486640:0:24693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397677696 00000100:00100000:3.0:1790972719.486647:0:24693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397677696 00000100:00100000:3.0:1790972719.486714:0:24693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790972719.486722:0:24693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e0548b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22669:x1877970397677696:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1790972719.486757:0:24693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000100:00100000:3.0:1790972719.499399:0:24693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e0548b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22669:x1877970397677696:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12671us (12953us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1790972719.499412:0:24693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790972719.499742:0:22669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22669:1877970397677696:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790972719.499770:0:22669:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:3.0:1790972719.669111:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790972720.373530:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790972720.373551:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e05489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397677824:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790972720.373619:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972720.375902:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790972720.375982:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397677952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790972720.376060:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972720.376094:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397677824 00000100:00100000:3.0:1790972720.376103:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397677824 00000100:00100000:3.0:1790972720.376149:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397677952 00000100:00100000:3.0:1790972720.376153:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397677952 00000100:00100000:3.0:1790972720.376171:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790972720.376180:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397677824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790972720.376213:0:22647:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790972720.376255:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05488a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397677824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (2637us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972720.376260:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790972720.376275:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790972720.376279:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397677952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790972720.376316:0:22647:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790972720.376345:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f777800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397677952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972720.376349:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790972720.376407:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d571c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397677952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790972720.381159:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e05489500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397677824:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1790972720.420258:0:25319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg339-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1790972720.692852:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790972721.015134:0:22676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1790972721.230204:0:25371:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1790972721.230441:0:25371:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1790972721.719155:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1790972721.999200:0:25421:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1790972721.999603:0:25421:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1790972722.306699:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972722.306826:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377649280 00000100:00100000:3.0:1790972722.306835:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377649280 00000100:00100000:3.0:1790972722.306911:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 115 00000100:00100000:3.0:1790972722.306919:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2395:x1877970377649280:12345-192.168.203.39@tcp:250:mount.lustre.0 00010000:00080000:3.0:1790972722.306947:0:22636:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from aa856691-2c52-48da-b123-663ad7a17d2e@192.168.203.39@tcp t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:3.0:1790972722.306972:0:22636:0:(genops.c:1384:class_connect()) connect: client aa856691-2c52-48da-b123-663ad7a17d2e, cookie 0xd61f4faa13a11d94 00000100:00080000:3.0:1790972722.307110:0:22636:0:(import.c:65:import_set_state_nolock()) ffff888e3f731000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790972722.307219:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a745850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+5:2395:x1877970377649280:12345-192.168.203.39@tcp:250:mount.lustre.0 Request processed in 298us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972722.307227:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 115 00000100:00100000:2.0:1790972722.328760:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972722.328887:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377649408 00000100:00100000:1.0:1790972722.328896:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377649408 00000100:00100000:1.0:1790972722.328951:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 116 00000100:00100000:1.0:1790972722.328960:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a740450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+5:18003:x1877970377649408:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790972722.328977:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972722.328993:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e1d1ea000/0xd61f4faa13a11d9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1d2c expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972722.329033:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e1d1ea000/0xd61f4faa13a11d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d2c expref: 6 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972722.329065:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e1d1ea000/0xd61f4faa13a11d9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d2c expref: 6 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972722.329074:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1ea000, rc 0) 00000100:00100000:1.0:1790972722.329175:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a740450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+6:18003:x1877970377649408:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 216us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972722.329183:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 116 00000100:00100000:1.0:1790972722.341468:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972722.344794:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377649536 00000100:00100000:3.0:1790972722.344808:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377649536 00000100:00100000:3.0:1790972722.344880:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:3.0:1790972722.344889:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+6:18003:x1877970377649536:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790972722.345012:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a741450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+6:18003:x1877970377649536:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 124us (3555us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790972722.345020:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 117 00000100:00100000:3.0:1790972722.348761:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972722.348954:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377649664 00000100:00100000:2.0:1790972722.348964:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377649664 00000100:00100000:2.0:1790972722.349026:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:2.0:1790972722.349036:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+6:18003:x1877970377649664:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790972722.349065:0:22637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972722.349082:0:22637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3d3cce00/0xd61f4faa13a11da2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1d33 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972722.349110:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3d3cce00/0xd61f4faa13a11da2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d33 expref: 7 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972722.349122:0:22637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3d3cce00/0xd61f4faa13a11da2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d33 expref: 7 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972722.349131:0:22637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3d3cce00, rc 0) 00000100:00100000:2.0:1790972722.349192:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a741050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+7:18003:x1877970377649664:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 157us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972722.349199:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 118 00000100:00100000:2.0:1790972722.351962:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972722.352054:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377649792 00000100:00100000:1.0:1790972722.352064:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377649792 00000100:00100000:1.0:1790972722.352114:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:1.0:1790972722.352122:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a740050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+7:18003:x1877970377649792:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790972722.352290:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a740050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+8:18003:x1877970377649792:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 167us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972722.352298:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 119 00000100:00100000:1.0:1790972722.364045:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972722.364120:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377649920 00000100:00100000:3.0:1790972722.364131:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377649920 00000100:00100000:3.0:1790972722.364187:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:3.0:1790972722.364197:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+8:18003:x1877970377649920:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790972722.364463:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a743450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+8:18003:x1877970377649920:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 267us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972722.364472:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 120 00000100:00100000:3.0:1790972722.377292:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972722.379435:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377650048 00000100:00100000:2.0:1790972722.379450:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377650048 00000100:00100000:2.0:1790972722.379509:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:2.0:1790972722.379531:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+8:18022:x1877970377650048:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790972722.379737:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a742050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+8:18022:x1877970377650048:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 207us (2453us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972722.379745:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 121 00000100:00100000:0.0:1790972722.415255:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972722.415686:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377650176 00000100:00100000:1.0:1790972722.415698:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377650176 00000100:00100000:1.0:1790972722.415762:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:1.0:1790972722.415772:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+8:18022:x1877970377650176:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790972722.415936:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a741850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+8:18022:x1877970377650176:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 164us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972722.415945:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 122 00000100:00100000:1.0:1790972722.420298:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972722.420572:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377650304 00000100:00100000:3.0:1790972722.420595:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377650304 00000100:00100000:3.0:1790972722.420653:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00100000:3.0:1790972722.420738:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+8:18022:x1877970377650304:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790972722.420940:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a742850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+8:18022:x1877970377650304:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 276us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972722.420950:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 123 00000100:00100000:1.0:1790972722.439866:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972722.440448:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377650432 00000100:00100000:3.0:1790972722.440459:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377650432 00000100:00100000:3.0:1790972722.440558:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 124 00000100:00100000:3.0:1790972722.440568:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+8:18003:x1877970377650432:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790972722.440722:0:22637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972722.440744:0:22637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888d07bb7800/0xd61f4faa13a11da9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1d64 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972722.440777:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888d07bb7800/0xd61f4faa13a11da9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d64 expref: 9 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972722.440789:0:22637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888d07bb7800/0xd61f4faa13a11da9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d64 expref: 9 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972722.440797:0:22637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d07bb7800, rc 0) 00000100:00100000:3.0:1790972722.440857:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a743c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+9:18003:x1877970377650432:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 290us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972722.440864:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 124 00000100:00100000:1.0:1790972722.445398:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972722.445482:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377650560 00000100:00100000:0.0:1790972722.445493:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377650560 00000100:00100000:0.0:1790972722.445554:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 125 00000100:00100000:0.0:1790972722.445564:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a740c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+9:18003:x1877970377650560:12345-192.168.203.39@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790972722.445591:0:22636:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790972722.445615:0:22636:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790972722.445620:0:22636:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790972722.445623:0:22636:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790972722.445626:0:22636:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1790972722.445628:0:22636:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1790972722.448244:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a740c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+9:18003:x1877970377650560:12345-192.168.203.39@tcp:256:mount.lustre.0 Request processed in 2671us (2846us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972722.448260:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 125 00000100:00100000:3.0:1790972722.453404:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972722.453515:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377650688 00000100:00100000:2.0:1790972722.453525:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377650688 00000100:00100000:2.0:1790972722.453586:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 126 00000100:00100000:2.0:1790972722.453798:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a742c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+9:18003:x1877970377650688:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790972722.453827:0:22637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972722.453844:0:22637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3d3cd000/0xd61f4faa13a11db0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1d6b expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972722.453872:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3d3cd000/0xd61f4faa13a11db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d6b expref: 10 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972722.453883:0:22637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3d3cd000/0xd61f4faa13a11db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d6b expref: 10 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972722.453898:0:22637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3d3cd000, rc 0) 00000100:00100000:2.0:1790972722.454007:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a742c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+10:18003:x1877970377650688:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 403us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972722.454014:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 126 00000100:00100000:1.0:1790972722.457214:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972722.459524:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377650816 00000100:00100000:0.0:1790972722.459539:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377650816 00000100:00100000:0.0:1790972722.459955:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 127 00000100:00100000:0.0:1790972722.459979:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+10:18003:x1877970377650816:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790972722.460162:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a741c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+10:18003:x1877970377650816:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 184us (2958us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972722.460170:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 127 00000100:00100000:1.0:1790972722.469765:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972722.469954:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377650944 00000100:00100000:2.0:1790972722.469964:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377650944 00000100:00100000:2.0:1790972722.470029:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 128 00000100:00100000:2.0:1790972722.470039:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+10:18003:x1877970377650944:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790972722.470190:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+10:18003:x1877970377650944:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 152us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972722.470198:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 128 00000100:00100000:3.0:1790972722.474138:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972722.474354:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377651072 00000100:00100000:0.0:1790972722.474364:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377651072 00000100:00100000:0.0:1790972722.474423:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 129 00000100:00100000:0.0:1790972722.474433:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+10:18027:x1877970377651072:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790972722.474604:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+10:18027:x1877970377651072:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 172us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972722.474613:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 129 00000100:00100000:0.0:1790972722.477523:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972722.477627:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377651200 00000100:00100000:1.0:1790972722.477636:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377651200 00000100:00100000:1.0:1790972722.477717:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 130 00000100:00100000:1.0:1790972722.477727:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+10:18027:x1877970377651200:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790972722.477873:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+10:18027:x1877970377651200:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 147us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972722.477881:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 130 00000100:00100000:1.0:1790972722.492805:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972722.493010:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972722.494094:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377651328 00000100:00100000:3.0:1790972722.494106:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377651328 00000100:00100000:2.0:1790972722.494213:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377651584 00000100:00100000:2.0:1790972722.494218:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377651584 00000100:00100000:2.0:1790972722.494245:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1790972722.494253:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1877970377651328:12345-192.168.203.39@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790972722.494283:0:22642:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 528aeac5-b99c-4b0d-ae9b-e84937861361@192.168.203.39@tcp t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:2.0:1790972722.494346:0:22642:0:(genops.c:1384:class_connect()) connect: client 528aeac5-b99c-4b0d-ae9b-e84937861361, cookie 0xd61f4faa13a11db7 00000004:00100000:2.0:1790972722.494370:0:22642:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790972722.494603:0:22642:0:(import.c:65:import_set_state_nolock()) ffff888d0785a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790972722.494686:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05489500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2395:x1877970377651328:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 431us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972722.494694:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1790972722.494712:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:2.0:1790972722.494717:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2395:x1877970377651584:12345-192.168.203.39@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790972722.494732:0:22642:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 528aeac5-b99c-4b0d-ae9b-e84937861361@192.168.203.39@tcp t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:2.0:1790972722.494760:0:22642:0:(genops.c:1384:class_connect()) connect: client 528aeac5-b99c-4b0d-ae9b-e84937861361, cookie 0xd61f4faa13a11dbe 00000004:00100000:2.0:1790972722.494771:0:22642:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1790972722.494884:0:22642:0:(import.c:65:import_set_state_nolock()) ffff888d0785d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790972722.495139:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05489880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2395:x1877970377651584:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 190us (1900us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972722.495147:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:3.0:1790972722.505122:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972722.505164:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972722.505200:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972722.505338:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377651712 00000100:00100000:1.0:1790972722.505349:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377651712 00000100:00100000:1.0:1790972722.505412:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377651456 00000100:00100000:1.0:1790972722.505415:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377651456 00000100:00100000:1.0:1790972722.505428:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377651840 00000100:00100000:1.0:1790972722.505430:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377651840 00000100:00100000:1.0:1790972722.505444:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:1.0:1790972722.505452:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+6:0:x1877970377651712:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790972722.505494:0:22643:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1790972722.505584:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d571c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+6:0:x1877970377651712:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 132us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972722.505609:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:1.0:1790972722.505631:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:1.0:1790972722.505638:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+7:0:x1877970377651456:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790972722.505654:0:22643:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790972722.505738:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d570700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+7:0:x1877970377651456:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 100us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972722.505744:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:1.0:1790972722.505759:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:1.0:1790972722.505765:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18003:x1877970377651840:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:1.0:1790972722.505775:0:22643:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1790972722.505796:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d573800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18003:x1877970377651840:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 32us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972722.505802:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00080000:3.0:1790972722.506426:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790972722.506431:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790972722.513479:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972722.513573:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377651968 00000100:00100000:2.0:1790972722.513583:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377651968 00000100:00100000:2.0:1790972722.513649:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:2.0:1790972722.513658:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18003:x1877970377651968:12345-192.168.203.39@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790972722.513789:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18003:x1877970377651968:12345-192.168.203.39@tcp:40:mount.lustre.0 Request processed in 132us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972722.513797:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:1.0:1790972722.531231:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972722.531322:0:22653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377652352 00000100:00100000:3.0:1790972722.531332:0:22653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377652352 00000100:00100000:3.0:1790972722.531405:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:3.0:1790972722.531417:0:22653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18003:x1877970377652352:12345-192.168.203.39@tcp:900:mount.lustre.0 00000100:00100000:3.0:1790972722.531523:0:22653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18003:x1877970377652352:12345-192.168.203.39@tcp:900:mount.lustre.0 Request processed in 108us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972722.531531:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:3.0:1790972722.534322:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972722.534375:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972722.534443:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377652096 00000100:00100000:0.0:1790972722.534453:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377652096 00000100:00100000:0.0:1790972722.534514:0:24147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:0.0:1790972722.534524:0:24147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1877970377652096:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790972722.534564:0:24147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 528aeac5-b99c-4b0d-ae9b-e84937861361@192.168.203.39@tcp t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:0.0:1790972722.534608:0:24147:0:(genops.c:1384:class_connect()) connect: client 528aeac5-b99c-4b0d-ae9b-e84937861361, cookie 0xd61f4faa13a11dc5 00002000:00100000:0.0:1790972722.534624:0:24147:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 528aeac5-b99c-4b0d-ae9b-e84937861361/ffff888d089c7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790972722.534645:0:24147:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1790972722.534721:0:22645:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377652480 00000100:00100000:1.0:1790972722.534725:0:22645:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377652480 00000100:00100000:1.0:1790972722.534759:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:1.0:1790972722.534765:0:22645:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18003:x1877970377652480:12345-192.168.203.39@tcp:33:mount.lustre.0 00002000:00080000:0.0:1790972722.534884:0:24147:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790972722.534919:0:24147:0:(import.c:65:import_set_state_nolock()) ffff888d089c6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790972722.534987:0:24147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d573480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2395:x1877970377652096:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 463us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972722.535021:0:24147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:0.0:1790972722.535112:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000004:00080000:0.0:1790972722.535794:0:22645:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 953us 00000100:00100000:2.0:1790972722.538561:0:24150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377652224 00000100:00100000:2.0:1790972722.538580:0:24150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377652224 00000100:00100000:2.0:1790972722.538637:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:2.0:1790972722.538654:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2395:x1877970377652224:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790972722.538711:0:24150:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 528aeac5-b99c-4b0d-ae9b-e84937861361@192.168.203.39@tcp t0 exp 0000000000000000 cur 660 last 0 00000020:00000080:2.0:1790972722.538748:0:24150:0:(genops.c:1384:class_connect()) connect: client 528aeac5-b99c-4b0d-ae9b-e84937861361, cookie 0xd61f4faa13a11dcc 00002000:00100000:2.0:1790972722.538761:0:24150:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 528aeac5-b99c-4b0d-ae9b-e84937861361/ffff888d07858800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790972722.538779:0:24150:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790972722.539102:0:24150:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790972722.539139:0:24150:0:(import.c:65:import_set_state_nolock()) ffff888e3ac1f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790972722.539215:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2395:x1877970377652224:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 561us (4102us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972722.539223:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000004:00200000:0.0:1790972722.559902:0:22645:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1790972722.560066:0:22645:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d571180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18003:x1877970377652480:12345-192.168.203.39@tcp:33:mount.lustre.0 Request processed in 25294us (25749us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972722.560080:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00010000:00010000:3.0:1790972722.740885:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972722.743331:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972722.743420:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377652608 00000100:00100000:0.0:1790972722.743431:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377652608 00000100:00100000:0.0:1790972722.743495:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:0.0:1790972722.743505:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18050:x1877970377652608:12345-192.168.203.39@tcp:101:mkdir.0 00010000:00010000:0.0:1790972722.743526:0:22644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790972722.743552:0:22644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdda00/0xd61f4faa13a11dd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1d9c expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972722.743635:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdce00/0xd61f4faa13a11dda lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972722.743648:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdce00/0xd61f4faa13a11dda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972722.743704:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdce00/0xd61f4faa13a11dda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790972722.743751:0:22644:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790972722.743755:0:22644:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1790972722.743790:0:22644:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdce00/0xd61f4faa13a11dda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972722.743833:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdda00/0xd61f4faa13a11dd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d9c expref: 8 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972722.743852:0:22644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdce00/0xd61f4faa13a11dda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d9c expref: 7 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972722.743860:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888e07716500) 00010000:00010000:0.0:1790972722.743863:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790972722.743866:0:22644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d06bdce00, rc 0) 00000100:00100000:0.0:1790972722.744193:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f774e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+7:18050:x1877970377652608:12345-192.168.203.39@tcp:101:mkdir.0 Request processed in 687us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972722.744201:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:2.0:1790972723.445060:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790972723.445086:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397678080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790972723.445165:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972723.445465:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397678080 00000100:00100000:3.0:1790972723.445473:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397678080 00000100:00100000:3.0:1790972723.445544:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790972723.445554:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397678080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790972723.445577:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1790972723.445630:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f775c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397678080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972723.445638:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1790972723.445703:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397678080:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790972723.445860:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790972723.765393:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972724.469144:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397678208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790972724.469216:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972724.469333:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397678208 00000100:00100000:1.0:1790972724.469342:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397678208 00000100:00100000:1.0:1790972724.469409:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790972724.469429:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397678208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790972724.469460:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790972724.469517:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f775180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397678208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972724.469525:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1790972724.469649:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790972724.469699:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397678208:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1790972724.469846:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397678336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790972724.469877:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972724.470023:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397678336 00000100:00100000:3.0:1790972724.470028:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397678336 00000100:00100000:3.0:1790972724.470065:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790972724.470073:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397678336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1790972724.470090:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1790972724.470124:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f777b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397678336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972724.470131:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790972724.470408:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397678592:0@lo:400:kworker.0 00000100:00100000:0.0:1790972724.470453:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972724.470487:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397679104:0@lo:400:kworker.0 00000100:00100000:0.0:1790972724.470509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972724.470524:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877970397679616:0@lo:400:kworker.0 00000100:00100000:0.0:1790972724.470550:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972724.470566:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1790972724.470572:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397678720:0@lo:400:kworker.0 00000100:00100000:0.0:1790972724.470595:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972724.470610:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877970397679232:0@lo:400:kworker.0 00000100:00100000:0.0:1790972724.470629:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972724.470642:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877970397679744:0@lo:400:kworker.0 00000100:00100000:0.0:1790972724.470702:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972724.470732:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397679616 00000100:00100000:0.0:1790972724.470738:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397679616 00000100:00100000:0.0:1790972724.470767:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397679232 00000100:00100000:0.0:1790972724.470769:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397679232 00000100:00100000:0.0:1790972724.470781:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397679744 00000100:00100000:0.0:1790972724.470783:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397679744 00000100:00100000:0.0:1790972724.470797:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790972724.470803:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877970397679616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972724.470842:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1877970397679616:12345-0@lo:400:kworker.0 Request processed in 40us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972724.470849:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790972724.470863:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790972724.470869:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877970397679232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972724.470909:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1877970397679232:12345-0@lo:400:kworker.0 Request processed in 26us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972724.470916:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790972724.470927:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790972724.470933:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877970397679744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972724.470960:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1877970397679744:12345-0@lo:400:kworker.0 Request processed in 27us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972724.470965:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790972724.471005:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3638:1877970397679232:0@lo:400:kworker.0 00010000:00080000:0.0:1790972724.471018:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888d088cbb80 x1877970397679744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972724.471027:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3638:1877970397679744:0@lo:400:kworker.0 00000100:00100000:0.0:1790972724.471048:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3638:1877970397679616:0@lo:400:kworker.0 00000100:00100000:3.0:1790972724.471252:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397678592 00000100:00100000:3.0:1790972724.471258:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397678592 00000100:00100000:3.0:1790972724.471290:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397679104 00000100:00100000:3.0:1790972724.471294:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397679104 00000100:00100000:3.0:1790972724.471309:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790972724.471315:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d5bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397678592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972724.471358:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d5bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397678592:12345-0@lo:400:kworker.0 Request processed in 43us (903us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972724.471365:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790972724.471377:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790972724.471383:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397679104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972724.471411:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397679104:12345-0@lo:400:kworker.0 Request processed in 28us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972724.471429:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790972724.471450:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397678720 00000100:00100000:3.0:1790972724.471453:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397678720 00000100:00100000:3.0:1790972724.471478:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790972724.471484:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397678720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972724.471513:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397678720:12345-0@lo:400:kworker.0 Request processed in 29us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972724.471528:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790972724.471554:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397678720:0@lo:400:kworker.0 00000100:00100000:3.0:1790972724.471565:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397678592:0@lo:400:kworker.0 00000100:00100000:3.0:1790972724.471574:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397679104:0@lo:400:kworker.0 00000100:00080000:2.0:1790972724.471736:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790972724.471741:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790972724.471744:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790972724.471757:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397678848:0@lo:400:kworker.0 00000100:00100000:2.0:1790972724.471786:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972724.471825:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877970397679360:0@lo:400:kworker.0 00000100:00100000:2.0:1790972724.471847:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972724.471865:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3f776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397679872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790972724.471896:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972724.471928:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3d573100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397678336:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1790972724.471946:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1790972724.471952:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3fa00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397678464:0@lo:400:kworker.0 00000100:00100000:2.0:1790972724.471977:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972724.472011:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877970397678976:0@lo:400:kworker.0 00000100:00100000:2.0:1790972724.472032:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972724.472048:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877970397679488:0@lo:400:kworker.0 00000100:00100000:2.0:1790972724.472067:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972724.472090:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397679872 00000100:00100000:2.0:1790972724.472094:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397679872 00000100:00100000:2.0:1790972724.472124:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790972724.472130:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1877970397679872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790972724.472145:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790972724.472177:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f777480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3640:x1877970397679872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972724.472184:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1790972724.472198:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790972724.472217:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3f776d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397679872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790972724.472237:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397679360 00000100:00100000:2.0:1790972724.472240:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397679360 00000100:00100000:2.0:1790972724.472260:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397678976 00000100:00100000:2.0:1790972724.472263:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397678976 00000100:00100000:2.0:1790972724.472284:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397679488 00000100:00100000:2.0:1790972724.472287:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397679488 00000100:00100000:2.0:1790972724.472302:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790972724.472307:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877970397679360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972724.472342:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f774700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877970397679360:12345-0@lo:400:kworker.0 Request processed in 35us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972724.472348:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790972724.472360:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790972724.472366:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877970397678976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972724.472392:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f776680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3640:x1877970397678976:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972724.472398:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790972724.472409:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790972724.472415:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877970397679488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972724.472472:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f775880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3640:x1877970397679488:12345-0@lo:400:kworker.0 Request processed in 58us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972724.472478:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1790972724.472493:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1790972724.472495:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790972724.472512:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3640:1877970397678976:0@lo:400:kworker.0 00010000:00080000:2.0:1790972724.472523:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3a7d0700 x1877970397679488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972740 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972724.472531:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3640:1877970397679488:0@lo:400:kworker.0 00000100:00100000:2.0:1790972724.472539:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877970397679360:0@lo:400:kworker.0 00000100:00100000:1.0:1790972724.473043:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397678464 00000100:00100000:1.0:1790972724.473058:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397678464 00000100:00100000:1.0:1790972724.473104:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790972724.473112:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:3640:x1877970397678464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972724.473161:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:3640:x1877970397678464:12345-0@lo:400:kworker.0 Request processed in 51us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972724.473168:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1790972724.473209:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3fa00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3640:1877970397678464:0@lo:400:kworker.0 00000100:00100000:3.0:1790972724.473317:0:24693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397678848 00000100:00100000:3.0:1790972724.473322:0:24693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397678848 00000100:00100000:3.0:1790972724.473357:0:24693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790972724.473364:0:24693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1877970397678848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790972724.473410:0:24693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f775f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3640:x1877970397678848:12345-0@lo:400:kworker.0 Request processed in 48us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972724.473425:0:24693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790972724.473590:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397678848:0@lo:400:kworker.0 00000100:00100000:3.0:1790972724.712538:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972724.712734:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377652736 00000100:00100000:2.0:1790972724.712759:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377652736 00000100:00100000:2.0:1790972724.712890:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:2.0:1790972724.712900:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+7:18103:x1877970377652736:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:2.0:1790972724.712943:0:22644:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790972724.713060:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+7:18103:x1877970377652736:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 161us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972724.713068:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:2.0:1790972724.719364:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972724.719702:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377652864 00000100:00100000:3.0:1790972724.719712:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377652864 00000100:00100000:3.0:1790972724.719783:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:3.0:1790972724.719793:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18103:x1877970377652864:12345-192.168.203.39@tcp:41:lfs.0 00000004:00000024:3.0:1790972724.719831:0:22642:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790972724.719917:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f776d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18103:x1877970377652864:12345-192.168.203.39@tcp:41:lfs.0 Request processed in 125us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972724.719925:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00080000:0.0:1790972724.720622:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790972724.720629:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790972724.727229:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972724.727357:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377652992 00000100:00100000:2.0:1790972724.727367:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377652992 00000100:00100000:2.0:1790972724.727496:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:2.0:1790972724.727507:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18103:x1877970377652992:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:2.0:1790972724.727540:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1790972724.727627:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08897100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18103:x1877970377652992:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 121us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972724.727636:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00080000:0.0:1790972724.730768:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790972724.734779:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972724.738359:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377653120 00000100:00100000:2.0:1790972724.738378:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377653120 00000100:00100000:2.0:1790972724.738480:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00100000:2.0:1790972724.738492:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18103:x1877970377653120:12345-192.168.203.39@tcp:13:lfs.0 00002000:00000024:2.0:1790972724.738520:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1790972724.738626:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18103:x1877970377653120:12345-192.168.203.39@tcp:13:lfs.0 Request processed in 135us (3855us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972724.738634:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 12 00000100:00080000:0.0:1790972724.738728:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1790972724.788912:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972724.962788:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972724.963716:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377653248 00000100:00100000:2.0:1790972724.963730:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377653248 00000100:00100000:2.0:1790972724.963814:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 132 00000100:00100000:2.0:1790972724.963825:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+10:18136:x1877970377653248:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790972724.963844:0:22637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972724.963863:0:22637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a11de1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1da3 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972724.963903:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a11de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1da3 expref: 11 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972724.963914:0:22637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3d3cc400/0xd61f4faa13a11de1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1da3 expref: 11 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972724.963923:0:22637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3d3cc400, rc 0) 00000100:00100000:2.0:1790972724.963999:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+11:18136:x1877970377653248:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 176us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972724.964006:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 132 00000100:00100000:3.0:1790972724.978769:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972724.978921:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377653376 00000100:00100000:2.0:1790972724.978932:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377653376 00000100:00100000:2.0:1790972724.979036:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 133 00000100:00100000:2.0:1790972724.979046:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+11:18136:x1877970377653376:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:2.0:1790972724.979223:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+11:18136:x1877970377653376:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 179us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972724.979231:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 133 00000100:00100000:1.0:1790972724.987461:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972724.988705:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377653504 00000100:00100000:3.0:1790972724.988728:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377653504 00000100:00100000:3.0:1790972724.988790:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 134 00000100:00100000:3.0:1790972724.988800:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+11:18136:x1877970377653504:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790972724.988958:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cde050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+11:18136:x1877970377653504:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 158us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972724.988966:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 134 00000001:00100000:1.0:1790972724.996965:0:24962:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 528aeac5-b99c-4b0d-ae9b-e84937861361 00000001:00080000:1.0:1790972724.996993:0:24962:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:0.0:1790972724.999714:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972725.000108:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377653632 00000100:00100000:3.0:1790972725.000119:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377653632 00000100:00100000:3.0:1790972725.000171:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 135 00000100:00100000:3.0:1790972725.000181:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+11:18142:x1877970377653632:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790972725.000356:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+11:18142:x1877970377653632:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 176us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972725.000365:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 135 00000100:00100000:3.0:1790972725.035936:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.039488:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377653760 00000100:00100000:2.0:1790972725.039504:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377653760 00000100:00100000:2.0:1790972725.039572:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 136 00000100:00100000:2.0:1790972725.039581:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+11:18142:x1877970377653760:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790972725.040112:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+11:18142:x1877970377653760:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 528us (4180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972725.040120:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 136 00000100:00100000:0.0:1790972725.050548:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972725.056863:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377653888 00000100:00100000:1.0:1790972725.056879:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377653888 00000100:00100000:1.0:1790972725.057017:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 137 00000100:00100000:1.0:1790972725.057027:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+11:18142:x1877970377653888:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790972725.057196:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+11:18142:x1877970377653888:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 170us (6657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972725.057204:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 137 00000100:00100000:0.0:1790972725.070805:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972725.070900:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377654016 00000100:00100000:3.0:1790972725.070910:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377654016 00000100:00100000:3.0:1790972725.070973:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 138 00000100:00100000:3.0:1790972725.070993:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+11:18136:x1877970377654016:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790972725.071009:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972725.071025:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888d07bb6600/0xd61f4faa13a11de8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1dd4 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972725.071053:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888d07bb6600/0xd61f4faa13a11de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1dd4 expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972725.071063:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888d07bb6600/0xd61f4faa13a11de8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1dd4 expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972725.071089:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d07bb6600, rc 0) 00000100:00100000:3.0:1790972725.071156:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+12:18136:x1877970377654016:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 166us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972725.071163:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 138 00000100:00100000:0.0:1790972725.078771:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972725.079008:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377654144 00000100:00100000:1.0:1790972725.079017:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377654144 00000100:00100000:1.0:1790972725.079069:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 139 00000100:00100000:1.0:1790972725.079078:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+12:18136:x1877970377654144:12345-192.168.203.39@tcp:256:mount.lustre.0 20000000:01000000:1.0:1790972725.079103:0:22637:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1790972725.079126:0:22637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1790972725.079134:0:22637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1790972725.079137:0:22637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1790972725.079139:0:22637:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1790972725.079141:0:22637:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1790972725.086470:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+12:18136:x1877970377654144:12345-192.168.203.39@tcp:256:mount.lustre.0 Request processed in 7381us (7698us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972725.086486:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 139 00000100:00100000:0.0:1790972725.093489:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.093729:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377654272 00000100:00100000:2.0:1790972725.093740:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377654272 00000100:00100000:2.0:1790972725.093833:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 140 00000100:00100000:2.0:1790972725.093845:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+12:18136:x1877970377654272:12345-192.168.203.39@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790972725.093863:0:22636:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972725.093881:0:22636:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e3d3cd400/0xd61f4faa13a11def lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1ddb expref: -99 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972725.093923:0:22636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3d3cd400/0xd61f4faa13a11def lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ddb expref: 13 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972725.093936:0:22636:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e3d3cd400/0xd61f4faa13a11def lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ddb expref: 13 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972725.093946:0:22636:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3d3cd400, rc 0) 00000100:00100000:2.0:1790972725.094015:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+13:18136:x1877970377654272:12345-192.168.203.39@tcp:101:mount.lustre.0 Request processed in 173us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972725.094026:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 140 00000100:00100000:0.0:1790972725.102727:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972725.102853:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377654400 00000100:00100000:1.0:1790972725.102868:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377654400 00000100:00100000:1.0:1790972725.102943:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 141 00000100:00100000:1.0:1790972725.102951:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d01cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+13:18136:x1877970377654400:12345-192.168.203.39@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790972725.103229:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d01cdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+13:18136:x1877970377654400:12345-192.168.203.39@tcp:501:mount.lustre.0 Request processed in 277us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972725.103237:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 141 00000100:00100000:0.0:1790972725.106960:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.107148:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377654528 00000100:00100000:2.0:1790972725.107160:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377654528 00000100:00100000:2.0:1790972725.107251:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 142 00000100:00100000:2.0:1790972725.107272:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+13:18136:x1877970377654528:12345-192.168.203.39@tcp:503:mount.lustre.0 00000100:00100000:2.0:1790972725.107518:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+13:18136:x1877970377654528:12345-192.168.203.39@tcp:503:mount.lustre.0 Request processed in 257us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972725.107535:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 142 00000100:00100000:0.0:1790972725.112821:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972725.112953:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377654656 00000100:00100000:1.0:1790972725.112964:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377654656 00000100:00100000:1.0:1790972725.113121:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 143 00000100:00100000:1.0:1790972725.113132:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+13:18145:x1877970377654656:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790972725.113470:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+13:18145:x1877970377654656:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 338us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972725.113480:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 143 00000100:00100000:0.0:1790972725.123232:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.125016:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377654784 00000100:00100000:2.0:1790972725.125031:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377654784 00000100:00100000:2.0:1790972725.125097:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 144 00000100:00100000:2.0:1790972725.125106:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+13:18145:x1877970377654784:12345-192.168.203.39@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790972725.125274:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+13:18145:x1877970377654784:12345-192.168.203.39@tcp:502:llog_process_th.0 Request processed in 167us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972725.125282:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 144 00000100:00100000:2.0:1790972725.132912:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.132954:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.133075:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.137608:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.137640:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972725.141720:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377655168 00000100:00100000:0.0:1790972725.141737:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377655168 00000100:00100000:0.0:1790972725.141988:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377655552 00000100:00100000:0.0:1790972725.141992:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377655552 00000100:00100000:0.0:1790972725.142030:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:3.0:1790972725.142036:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377654912 00000100:00100000:0.0:1790972725.142041:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3d573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+7:2397:x1877970377655552:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1790972725.142044:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377654912 00000100:00100000:3.0:1790972725.142076:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:3.0:1790972725.142083:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2395:x1877970377655168:12345-192.168.203.39@tcp:38:mount.lustre.0 00010000:00080000:3.0:1790972725.142109:0:22643:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 7e7e985b-53ac-495e-afad-1d490636b4f4@192.168.203.39@tcp t0 exp 0000000000000000 cur 663 last 0 00000020:00000080:3.0:1790972725.142147:0:22643:0:(genops.c:1384:class_connect()) connect: client 7e7e985b-53ac-495e-afad-1d490636b4f4, cookie 0xd61f4faa13a11df6 00000004:00100000:3.0:1790972725.142173:0:22643:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00100000:0.0:1790972725.142208:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3d573100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+7:2397:x1877970377655552:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 168us (9130us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972725.142217:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:0.0:1790972725.142239:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:0.0:1790972725.142244:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2395:x1877970377654912:12345-192.168.203.39@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790972725.142260:0:22644:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 7e7e985b-53ac-495e-afad-1d490636b4f4@192.168.203.39@tcp t0 exp 0000000000000000 cur 663 last 0 00000020:00000080:0.0:1790972725.142298:0:22644:0:(genops.c:1384:class_connect()) connect: client 7e7e985b-53ac-495e-afad-1d490636b4f4, cookie 0xd61f4faa13a11dfd 00000004:00100000:0.0:1790972725.142313:0:22644:0:(mdt_handler.c:7295:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790972725.142365:0:22644:0:(import.c:65:import_set_state_nolock()) ffff888d089c2800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1790972725.142636:0:22643:0:(import.c:65:import_set_state_nolock()) ffff888d05dac800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790972725.142697:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f776a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+6:2395:x1877970377655168:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 613us (9742us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972725.142762:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:3.0:1790972725.142798:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377655808 00000100:00100000:3.0:1790972725.142802:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377655808 00000100:00100000:3.0:1790972725.142832:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:3.0:1790972725.142839:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3f74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2397:x1877970377655808:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1790972725.142867:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f74d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2397:x1877970377655808:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (5270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972725.142873:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:0.0:1790972725.142929:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3f775500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7e7e985b-53ac-495e-afad-1d490636b4f4+6:2395:x1877970377654912:12345-192.168.203.39@tcp:38:mount.lustre.0 Request processed in 681us (10026us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972725.142936:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:2.0:1790972725.143930:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377655680 00000100:00100000:2.0:1790972725.143938:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377655680 00000100:00100000:2.0:1790972725.143995:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:2.0:1790972725.144003:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2397:x1877970377655680:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1790972725.144049:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2397:x1877970377655680:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 47us (6407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972725.144055:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:2.0:1790972725.144139:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.144184:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377655936 00000100:00100000:2.0:1790972725.144188:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377655936 00000100:00100000:2.0:1790972725.144220:0:24147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:2.0:1790972725.144227:0:24147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2397:x1877970377655936:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1790972725.144567:0:24147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2397:x1877970377655936:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 339us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972725.144576:0:24147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:0.0:1790972725.156339:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972725.156387:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.156449:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377655040 00000100:00100000:2.0:1790972725.156460:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377655040 00000100:00100000:0.0:1790972725.156476:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.156514:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377655424 00000100:00100000:0.0:1790972725.156515:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377655296 00000100:00100000:2.0:1790972725.156517:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377655424 00000100:00100000:0.0:1790972725.156518:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377655296 00000100:00100000:2.0:1790972725.156533:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:2.0:1790972725.156541:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7e7e985b-53ac-495e-afad-1d490636b4f4+7:0:x1877970377655040:12345-192.168.203.39@tcp:41:mount.lustre.0 00000100:00080000:3.0:1790972725.156611:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1790972725.156615:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1790972725.157077:0:23867:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790972725.157151:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7e7e985b-53ac-495e-afad-1d490636b4f4+7:0:x1877970377655040:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 609us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972725.157597:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:0.0:1790972725.157610:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+7:18136:x1877970377655424:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790972725.157627:0:22642:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1790972725.157657:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+7:18136:x1877970377655424:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 52us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972725.157678:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:0.0:1790972725.157696:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:0.0:1790972725.157703:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+6:0:x1877970377655296:12345-192.168.203.39@tcp:41:mount.lustre.0 00000004:00000024:0.0:1790972725.157721:0:22642:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1790972725.157749:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+6:0:x1877970377655296:12345-192.168.203.39@tcp:41:mount.lustre.0 Request processed in 47us (1272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972725.157755:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:2.0:1790972725.174437:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00000100:00100000:0.0:1790972725.177111:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972725.177221:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377656064 00000100:00100000:1.0:1790972725.177231:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377656064 00000100:00100000:1.0:1790972725.177285:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:1.0:1790972725.177420:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+6:18136:x1877970377656064:12345-192.168.203.39@tcp:40:mount.lustre.0 00000100:00100000:1.0:1790972725.177510:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+6:18136:x1877970377656064:12345-192.168.203.39@tcp:40:mount.lustre.0 Request processed in 216us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972725.177531:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:2.0:1790972725.181281:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.181329:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972725.181449:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972725.181527:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377656192 00000100:00100000:1.0:1790972725.181535:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377656192 00000100:00100000:1.0:1790972725.181572:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377656320 00000100:00100000:1.0:1790972725.181576:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377656320 00000100:00100000:1.0:1790972725.181604:0:24147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:1.0:1790972725.181613:0:24147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1877970377656192:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790972725.181646:0:24147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 7e7e985b-53ac-495e-afad-1d490636b4f4@192.168.203.39@tcp t0 exp 0000000000000000 cur 663 last 0 00000020:00000080:1.0:1790972725.181694:0:24147:0:(genops.c:1384:class_connect()) connect: client 7e7e985b-53ac-495e-afad-1d490636b4f4, cookie 0xd61f4faa13a11e04 00002000:00100000:1.0:1790972725.181704:0:24147:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7e7e985b-53ac-495e-afad-1d490636b4f4/ffff888d07a91800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790972725.181714:0:24147:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790972725.181773:0:24147:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790972725.181798:0:24147:0:(import.c:65:import_set_state_nolock()) ffff888d07a94800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790972725.181865:0:24147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+6:2395:x1877970377656192:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 252us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972725.181872:0:24147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:1.0:1790972725.181890:0:24147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:1.0:1790972725.181895:0:24147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2395:x1877970377656320:12345-192.168.203.39@tcp:8:mount.lustre.0 00010000:00080000:1.0:1790972725.181911:0:24147:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 7e7e985b-53ac-495e-afad-1d490636b4f4@192.168.203.39@tcp t0 exp 0000000000000000 cur 663 last 0 00000020:00000080:1.0:1790972725.181925:0:24147:0:(genops.c:1384:class_connect()) connect: client 7e7e985b-53ac-495e-afad-1d490636b4f4, cookie 0xd61f4faa13a11e0b 00002000:00100000:1.0:1790972725.181930:0:24147:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7e7e985b-53ac-495e-afad-1d490636b4f4/ffff888d07a93800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113b02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790972725.181935:0:24147:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790972725.181987:0:24147:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790972725.182029:0:24147:0:(import.c:65:import_set_state_nolock()) ffff888e2d679000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790972725.182060:0:24147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+6:2395:x1877970377656320:12345-192.168.203.39@tcp:8:mount.lustre.0 Request processed in 164us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972725.182067:0:24147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:3.0:1790972725.183104:0:22653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377656448 00000100:00100000:3.0:1790972725.183114:0:22653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377656448 00000100:00100000:1.0:1790972725.183248:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:1.0:1790972725.183258:0:22653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7e7e985b-53ac-495e-afad-1d490636b4f4+6:18136:x1877970377656448:12345-192.168.203.39@tcp:900:mount.lustre.0 00000100:00100000:1.0:1790972725.183330:0:22653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7e7e985b-53ac-495e-afad-1d490636b4f4+6:18136:x1877970377656448:12345-192.168.203.39@tcp:900:mount.lustre.0 Request processed in 74us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972725.183342:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:2.0:1790972725.186052:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972725.186417:0:22646:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377656576 00000100:00100000:3.0:1790972725.186427:0:22646:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377656576 00000100:00100000:3.0:1790972725.186474:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:3.0:1790972725.186484:0:22646:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+6:18136:x1877970377656576:12345-192.168.203.39@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790972725.186577:0:22646:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790972725.186879:0:22646:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+6:18136:x1877970377656576:12345-192.168.203.39@tcp:33:mount.lustre.0 Request processed in 273us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972725.186889:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:0.0:1790972725.361392:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972725.361515:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377656704 00000100:00100000:3.0:1790972725.361525:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377656704 00000100:00100000:3.0:1790972725.361596:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:3.0:1790972725.361608:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+6:18168:x1877970377656704:12345-192.168.203.39@tcp:101:mkdir.0 00010000:00010000:3.0:1790972725.361628:0:22643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972725.361702:0:22643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7200/0xd61f4faa13a11e12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e0c expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972725.361766:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7a00/0xd61f4faa13a11e19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972725.361781:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7a00/0xd61f4faa13a11e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972725.361795:0:22643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7a00/0xd61f4faa13a11e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790972725.361835:0:22643:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790972725.361839:0:22643:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790972725.361884:0:22643:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7a00/0xd61f4faa13a11e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972725.362137:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7200/0xd61f4faa13a11e12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e0c expref: 8 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972725.362154:0:22643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7a00/0xd61f4faa13a11e19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e0c expref: 7 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972725.362162:0:22643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888e07716500) 00010000:00010000:3.0:1790972725.362165:0:22643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790972725.362168:0:22643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d07bb7a00, rc 0) 00000100:00100000:3.0:1790972725.362233:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+7:18168:x1877970377656704:12345-192.168.203.39@tcp:101:mkdir.0 Request processed in 627us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972725.362240:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:2.0:1790972725.493857:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790972725.493893:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397680000:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790972725.493989:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972725.494047:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790972725.494059:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397680128:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790972725.494088:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972725.494180:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397680000 00000100:00100000:2.0:1790972725.494188:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397680000 00000100:00100000:2.0:1790972725.494248:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397680128 00000100:00100000:2.0:1790972725.494252:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397680128 00000100:00100000:2.0:1790972725.494272:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790972725.494281:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397680000:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1790972725.494308:0:22648:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1790972725.494379:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397680000:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972725.494387:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790972725.494406:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790972725.494413:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397680128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1790972725.494446:0:22648:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1790972725.494495:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397680128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972725.494502:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790972725.494547:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397680000:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790972725.494585:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397680128:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1790972725.812879:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790972726.389333:0:23395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790972726.837012:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972727.860965:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790972728.060316:0:23374:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7e7e985b-53ac-495e-afad-1d490636b4f4 00000001:00100000:2.0:1790972728.060329:0:23374:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 528aeac5-b99c-4b0d-ae9b-e84937861361 00000001:00100000:1.0:1790972728.060694:0:22622:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7e7e985b-53ac-495e-afad-1d490636b4f4 00000001:00100000:1.0:1790972728.060701:0:22622:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 528aeac5-b99c-4b0d-ae9b-e84937861361 00000001:00100000:1.0:1790972728.074185:0:24144:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7e7e985b-53ac-495e-afad-1d490636b4f4 00000001:00100000:1.0:1790972728.074197:0:24144:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 528aeac5-b99c-4b0d-ae9b-e84937861361 00000001:02000400:0.0:1790972728.142304:0:25520:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1790972728.566696:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790972728.566721:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397680256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790972728.566790:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972728.566901:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397680256 00000100:00100000:1.0:1790972728.566910:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397680256 00000100:00100000:1.0:1790972728.566987:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790972728.566996:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397680256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790972728.567026:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1790972728.567083:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397680256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972728.567090:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790972728.567715:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397680256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1790972728.567721:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790972728.884881:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972729.589060:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3adfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397680384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790972729.589130:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972729.589365:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397680512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790972729.589395:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972729.589432:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397680384 00000100:00100000:1.0:1790972729.589440:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397680384 00000100:00100000:0.0:1790972729.589467:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397680640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790972729.589507:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972729.589508:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397680512 00000100:00100000:1.0:1790972729.589513:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397680512 00000100:00100000:1.0:1790972729.589530:0:24152:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397680640 00000100:00100000:1.0:1790972729.589532:0:24152:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397680640 00000100:00100000:1.0:1790972729.589551:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790972729.589559:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397680384:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1790972729.589574:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790972729.589580:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1790972729.589588:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1790972729.589641:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397680384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972729.589648:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790972729.589688:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790972729.589696:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397680512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1790972729.589706:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790972729.589731:0:3640:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:1.0:1790972729.589754:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397680512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972729.589759:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3adfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397680384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790972729.589766:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790972729.589782:0:24152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790972729.589790:0:24152:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397680640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1790972729.589799:0:24152:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790972729.589809:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397680512:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790972729.589832:0:24152:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07e1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1877970397680640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972729.589839:0:24152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790972729.589850:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3638:1877970397680640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790972729.590301:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3639:1877970397680768:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.590337:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972729.590369:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397681280:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.590397:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972729.590417:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877970397681792:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.590443:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972729.590463:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790972729.590467:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877970397681152:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.590489:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972729.590502:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877970397681664:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.590520:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972729.590555:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397680768 00000100:00100000:0.0:1790972729.590560:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397680768 00000100:00100000:0.0:1790972729.590595:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790972729.590603:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:3639:x1877970397680768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.590656:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:3639:x1877970397680768:12345-0@lo:400:kworker.0 Request processed in 53us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972729.590693:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1790972729.590722:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397681280 00000100:00100000:0.0:1790972729.590726:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397681280 00000100:00100000:0.0:1790972729.590751:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790972729.590757:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397681280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.590792:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397681280:12345-0@lo:400:kworker.0 Request processed in 35us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972729.590804:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790972729.590822:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397681792 00000100:00100000:0.0:1790972729.590825:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397681792 00000100:00100000:0.0:1790972729.590852:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397681152 00000100:00100000:0.0:1790972729.590856:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397681152 00000100:00100000:0.0:1790972729.590867:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397681664 00000100:00100000:0.0:1790972729.590870:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397681664 00000100:00100000:0.0:1790972729.590883:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790972729.590888:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877970397681792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.590919:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3639:x1877970397681792:12345-0@lo:400:kworker.0 Request processed in 30us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972729.590925:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790972729.590940:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790972729.590961:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877970397681152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972729.590996:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790972729.590997:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3639:x1877970397681152:12345-0@lo:400:kworker.0 Request processed in 35us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972729.591010:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877970397681664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591016:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1790972729.591054:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790972729.591056:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a7d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877970397681664:12345-0@lo:400:kworker.0 Request processed in 51us (534us total) trans 0 rc 0/0 00000100:00080000:0.0:1790972729.591059:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790972729.591072:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397680896:0@lo:400:kworker.0 00000100:00100000:1.0:1790972729.591076:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1790972729.591107:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972729.591136:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877970397681408:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591161:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972729.591184:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3a7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877970397681920:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591208:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972729.591233:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790972729.591240:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397681024:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591262:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972729.591278:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877970397681536:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591298:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972729.591339:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397681408 00000100:00100000:0.0:1790972729.591343:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397681408 00000100:00100000:0.0:1790972729.591363:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397681920 00000100:00100000:0.0:1790972729.591366:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397681920 00000100:00100000:0.0:1790972729.591382:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397681536 00000100:00100000:0.0:1790972729.591384:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397681536 00000100:00100000:0.0:1790972729.591398:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790972729.591403:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877970397681408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591437:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3640:x1877970397681408:12345-0@lo:400:kworker.0 Request processed in 33us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972729.591442:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1790972729.591454:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790972729.591466:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877970397681920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591495:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3640:x1877970397681920:12345-0@lo:400:kworker.0 Request processed in 30us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972729.591501:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790972729.591513:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1790972729.591518:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877970397681536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591543:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3640:x1877970397681536:12345-0@lo:400:kworker.0 Request processed in 25us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972729.591550:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790972729.591555:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397680896 00000100:00100000:1.0:1790972729.591561:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397680896 00000100:00080000:0.0:1790972729.591567:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790972729.591571:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790972729.591593:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1790972729.591601:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397680896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591625:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07e19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3639:1877970397681152:0@lo:400:kworker.0 00000100:00100000:1.0:1790972729.591644:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397680896:12345-0@lo:400:kworker.0 Request processed in 42us (534us total) trans 0 rc 0/0 00010000:00080000:0.0:1790972729.591645:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3a7d1500 x1877970397681664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972729.591681:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877970397681664:0@lo:400:kworker.0 00000100:00100000:1.0:1790972729.591686:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790972729.591694:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07e1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3639:1877970397680768:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591706:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07e1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397681280:0@lo:400:kworker.0 00000100:00100000:1.0:1790972729.591716:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397681024 00000100:00100000:0.0:1790972729.591720:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3639:1877970397681792:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591755:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e0548b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3640:1877970397681536:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591763:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07e1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397680896:0@lo:400:kworker.0 00000100:00100000:0.0:1790972729.591772:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07e19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3640:1877970397681408:0@lo:400:kworker.0 00010000:00080000:0.0:1790972729.591781:0:3640:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e3a7d0700 x1877970397681920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972745 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790972729.591799:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3a7d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3640:1877970397681920:0@lo:400:kworker.0 00000100:00100000:1.0:1790972729.592929:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397681024 00000100:00100000:1.0:1790972729.593000:0:24147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790972729.593010:0:24147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397681024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972729.593089:0:24147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3640:x1877970397681024:12345-0@lo:400:kworker.0 Request processed in 81us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972729.593096:0:24147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790972729.593790:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07e18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3640:1877970397681024:0@lo:400:kworker.0 00010000:00010000:3.0:1790972729.910907:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790972730.604908:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972730.604954:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972730.604987:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972730.605009:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972730.605019:0:24693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377657216 00000100:00100000:3.0:1790972730.605030:0:24693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377657216 00000100:00100000:1.0:1790972730.605038:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972730.605065:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972730.605089:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972730.605148:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377656960 00000100:00100000:0.0:1790972730.605153:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377656960 00000100:00100000:0.0:1790972730.605205:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377657472 00000100:00100000:0.0:1790972730.605209:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377657472 00000100:00100000:0.0:1790972730.605225:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377657088 00000100:00100000:0.0:1790972730.605228:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377657088 00000100:00100000:0.0:1790972730.605249:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:0.0:1790972730.605261:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2396:x1877970377656960:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972730.605339:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2396:x1877970377656960:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 81us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972730.605347:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:0.0:1790972730.605366:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:0.0:1790972730.605373:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7e7e985b-53ac-495e-afad-1d490636b4f4+6:2396:x1877970377657472:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972730.605400:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7e7e985b-53ac-495e-afad-1d490636b4f4+6:2396:x1877970377657472:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972730.605406:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:0.0:1790972730.605417:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:0.0:1790972730.605424:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2396:x1877970377657088:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972730.605451:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2396:x1877970377657088:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 28us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972730.605458:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:1.0:1790972730.605534:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972730.605603:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972730.612932:0:3640:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790972730.612963:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3adfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397682048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1790972730.613035:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972730.613474:0:24693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377657728 00000100:00100000:3.0:1790972730.613484:0:24693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377657728 00000100:00100000:3.0:1790972730.613530:0:24693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377657344 00000100:00100000:3.0:1790972730.613550:0:24693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377657344 00000100:00100000:3.0:1790972730.613572:0:24693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:3.0:1790972730.613580:0:24693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2396:x1877970377657216:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:3.0:1790972730.613644:0:24693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2396:x1877970377657216:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 65us (8689us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972730.613651:0:24693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:3.0:1790972730.613687:0:24693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:3.0:1790972730.613694:0:24693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7e7e985b-53ac-495e-afad-1d490636b4f4+5:2396:x1877970377657728:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972730.614090:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:0.0:1790972730.614104:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2396:x1877970377657344:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972730.614146:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08897b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2396:x1877970377657344:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 47us (9056us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972730.614152:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00080000:0.0:1790972730.614178:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790972730.614196:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1790972730.614201:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790972730.614204:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790972730.614220:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377657600 00000100:00100000:0.0:1790972730.614225:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377657600 00000100:00100000:0.0:1790972730.614269:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:0.0:1790972730.614276:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+5:2396:x1877970377657600:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972730.614304:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+5:2396:x1877970377657600:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 29us (8771us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972730.614309:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00080000:0.0:1790972730.614454:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1790972730.614494:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397682176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1790972730.614524:0:24693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08896300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7e7e985b-53ac-495e-afad-1d490636b4f4+5:2396:x1877970377657728:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 828us (9513us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972730.614532:0:24693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:0.0:1790972730.614539:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972730.614583:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397682048 00000100:00100000:0.0:1790972730.614587:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397682048 00000100:00100000:0.0:1790972730.614616:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397682176 00000100:00100000:0.0:1790972730.614620:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397682176 00000100:00100000:0.0:1790972730.614635:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790972730.614642:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397682048:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1790972730.614654:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790972730.614683:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397682176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790972730.614703:0:22648:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000004:00000024:0.0:1790972730.614862:0:22647:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1790972730.614876:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397682176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 212us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972730.614884:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790972730.614912:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397682048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 269us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972730.614927:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790972730.614933:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397682176:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1790972730.616023:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377656832 00000100:00100000:0.0:1790972730.616033:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377656832 00000100:00100000:0.0:1790972730.616081:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 146 00000100:00100000:0.0:1790972730.616090:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+13:2396:x1877970377656832:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972730.616146:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+13:2396:x1877970377656832:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 57us (11107us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972730.616152:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 146 00000100:00100000:0.0:1790972730.618071:0:24150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377657856 00000100:00100000:0.0:1790972730.618084:0:24150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377657856 00000100:00100000:0.0:1790972730.618191:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:0.0:1790972730.618201:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7e7e985b-53ac-495e-afad-1d490636b4f4+6:2396:x1877970377657856:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:0.0:1790972730.618264:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7e7e985b-53ac-495e-afad-1d490636b4f4+6:2396:x1877970377657856:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 64us (12661us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972730.618271:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00080000:1.0:1790972730.618365:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790972730.620108:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3adfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397682048:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1790972730.943399:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790972731.128557:0:24962:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7e7e985b-53ac-495e-afad-1d490636b4f4 00000040:00080000:1.0:1790972731.254302:0:22676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1790972731.701649:0:25668:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff95e04ad0 20000000:00000080:0.0:1790972731.701872:0:25668:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff888e3b20a400 uarg=0000000000000000 20000000:01000000:0.0:1790972731.702086:0:25668:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790972731.702091:0:25668:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790972731.702095:0:25668:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1790972731.702529:0:25669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:2.0:1790972731.702714:0:25668:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790972731.716838:0:25668:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790972731.717050:0:25668:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.717071:0:25668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e3ad43c00/0xd61f4faa13a11a7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a76 expref: 23 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.717100:0:25668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e15084400/0xd61f4faa13a11a8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11a84 expref: 23 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.717107:0:25668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e3d3cc800/0xd61f4faa13a11aca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11ac3 expref: 23 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.717114:0:25668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888d06bdc600/0xd61f4faa13a11c4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11c44 expref: 23 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.717124:0:25668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e3d3cd000/0xd61f4faa13a11db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d6b expref: 12 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.717132:0:25668:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff888e3d3cd400/0xd61f4faa13a11def lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ddb expref: 12 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.717140:0:25668:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.717182:0:25668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e3d3cd400/0xd61f4faa13a11def lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ddb expref: 12 pid: 22636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.717197:0:25668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e3d3cd400/0xd61f4faa13a11def lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ddb expref: 12 pid: 22636 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972731.717213:0:25668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3adfa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25668:1877970397682304:192.168.203.39@tcp:104: 00010000:00010000:2.0:1790972731.717363:0:25668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e3d3cd000/0xd61f4faa13a11db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d6b expref: 12 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.717372:0:25668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e3d3cd000/0xd61f4faa13a11db0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d6b expref: 12 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972731.717390:0:25668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3adfb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25668:1877970397682432:192.168.203.39@tcp:104: 00010000:00010000:2.0:1790972731.717428:0:25668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888d06bdc600/0xd61f4faa13a11c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11c44 expref: 23 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.717437:0:25668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888d06bdc600/0xd61f4faa13a11c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11c44 expref: 23 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972731.717446:0:25668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3adfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25668:1877970397682560:0@lo:104: 00000100:00100000:2.0:1790972731.717484:0:25668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790972731.718208:0:25668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e3d3cc800/0xd61f4faa13a11aca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11ac3 expref: 23 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.718220:0:25668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e3d3cc800/0xd61f4faa13a11aca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11ac3 expref: 23 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972731.718229:0:25668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3adf8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25668:1877970397682688:0@lo:104: 00000100:00100000:2.0:1790972731.718261:0:25668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790972731.718290:0:25668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e15084400/0xd61f4faa13a11a8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11a84 expref: 23 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.718298:0:25668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e15084400/0xd61f4faa13a11a8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11a84 expref: 23 pid: 22634 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972731.718306:0:25668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3adf8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25668:1877970397682816:0@lo:104: 00000100:00100000:2.0:1790972731.718328:0:25668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790972731.718347:0:25668:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff888e3ad43c00/0xd61f4faa13a11a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd61f4faa13a11a76 expref: 23 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.718368:0:25668:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff888e3ad43c00/0xd61f4faa13a11a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd61f4faa13a11a76 expref: 23 pid: 22634 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972731.718377:0:25668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3adfbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25668:1877970397682944:0@lo:104: 00000100:00100000:2.0:1790972731.718401:0:25668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972731.718411:0:25668:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972731.719079:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397682560 00000100:00100000:3.0:1790972731.719089:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397682560 00000100:00100000:3.0:1790972731.719134:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397682688 00000100:00100000:3.0:1790972731.719137:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397682688 00000100:00100000:3.0:1790972731.719148:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397682816 00000100:00100000:3.0:1790972731.719151:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397682816 00000100:00100000:3.0:1790972731.719161:0:22626:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397682944 00000100:00100000:3.0:1790972731.719173:0:22626:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397682944 00000100:00100000:3.0:1790972731.719193:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790972731.719202:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+6:25668:x1877970397682560:12345-0@lo:104: 00010000:00010000:3.0:1790972731.719215:0:22626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11c4b expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719298:0:22626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790972731.719304:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+6:25668:x1877970397682560:12345-0@lo:104: Request processed in 104us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972731.719310:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790972731.719328:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790972731.719334:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+5:25668:x1877970397682688:12345-0@lo:104: 00010000:00010000:3.0:1790972731.719341:0:22626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11aca expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719374:0:22626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790972731.719379:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+5:25668:x1877970397682688:12345-0@lo:104: Request processed in 46us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972731.719384:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790972731.719396:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790972731.719401:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+4:25668:x1877970397682816:12345-0@lo:104: 00010000:00010000:3.0:1790972731.719408:0:22626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11a8b expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719430:0:22626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790972731.719434:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+4:25668:x1877970397682816:12345-0@lo:104: Request processed in 34us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972731.719439:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790972731.719458:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790972731.719463:0:22626:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08950e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+3:25668:x1877970397682944:12345-0@lo:104: 00010000:00010000:3.0:1790972731.719469:0:22626:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11a7d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719495:0:22626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1790972731.719499:0:22626:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08950e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+3:25668:x1877970397682944:12345-0@lo:104: Request processed in 37us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972731.719504:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1790972731.719522:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1790972731.719528:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11c4b expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719535:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad42400 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:3.0:1790972731.719539:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a11c4b expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719547:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a11c4b expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790972731.719556:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a11c4b expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972731.719561:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790972731.719592:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11c4b expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719598:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790972731.719617:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11c4b expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719633:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3ad42400/0xd61f4faa13a11c44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11c4b expref: -99 pid: 24961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719646:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790972731.719649:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11aca expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719654:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad43800 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:3.0:1790972731.719657:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a11aca expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719691:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a11aca expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790972731.719697:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a11aca expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972731.719701:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790972731.719715:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11aca expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719720:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790972731.719737:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11aca expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719745:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11ac3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11aca expref: -99 pid: 24143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719755:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790972731.719766:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11a8b expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719771:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad42800 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:3.0:1790972731.719773:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a11a8b expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719779:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a11a8b expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790972731.719785:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a11a8b expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972731.719789:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790972731.719801:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a8b expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719806:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790972731.719811:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a8b expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719817:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11a84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a8b expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719826:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790972731.719829:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd61f4faa13a11a7d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.719833:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e09feaa00 already unused, calling callback (ffffffffc13a6c20) 10000000:00010000:3.0:1790972731.719836:0:22631:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd61f4faa13a11a7d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.720077:0:22631:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd61f4faa13a11a7d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790972731.720085:0:22631:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd61f4faa13a11a7d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790972731.720090:0:22631:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790972731.720107:0:22631:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a7d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.720114:0:22631:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790972731.720122:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a7d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.720128:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.139@tcp lock: ffff888e09feaa00/0xd61f4faa13a11a76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd61f4faa13a11a7d expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972731.720134:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397683328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790972731.720147:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972731.720150:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972731.720152:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972731.720161:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972731.720178:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3639:1877970397683072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790972731.720388:0:25668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3adfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25668:1877970397682560:0@lo:104: 00000100:00100000:2.0:1790972731.720398:0:25668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3adf8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25668:1877970397682688:0@lo:104: 00000100:00100000:2.0:1790972731.720406:0:25668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3adf8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25668:1877970397682816:0@lo:104: 00000100:00100000:2.0:1790972731.720413:0:25668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3adfbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25668:1877970397682944:0@lo:104: 00000100:00100000:3.0:1790972731.720735:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972731.720762:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972731.720780:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790972731.720790:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790972731.720791:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3639:1877970397683456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790972731.720800:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397683200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790972731.720823:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972731.721329:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397683072 00000100:00100000:3.0:1790972731.721337:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397683072 00010000:00010000:3.0:1790972731.721378:0:22628:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888d06bdc600/0xd61f4faa13a11c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11c44 expref: 24 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972731.721407:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397683328 00000100:00100000:3.0:1790972731.721410:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397683328 00010000:00010000:3.0:1790972731.721424:0:22628:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e15084400/0xd61f4faa13a11a8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11a84 expref: 25 pid: 22634 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972731.721435:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397683456 00000100:00100000:3.0:1790972731.721438:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397683456 00010000:00010000:3.0:1790972731.721450:0:22628:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e3ad43c00/0xd61f4faa13a11a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11a76 expref: 26 pid: 22634 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972731.721464:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790972731.721473:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+26:3639:x1877970397683072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790972731.721489:0:22628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790972731.721495:0:22628:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888d06bdc600/0xd61f4faa13a11c4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11c44 expref: 26 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.721506:0:22628:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888d06bdc600/0xd61f4faa13a11c4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11c44 expref: 26 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972731.721574:0:23795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790972731.721585:0:23795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+26:3641:x1877970397683328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972731.721595:0:23795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972731.721601:0:23795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e15084400/0xd61f4faa13a11a8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11a84 expref: 26 pid: 22634 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972731.721688:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790972731.722306:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888d06bdc600/0xd61f4faa13a11c4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11c44 expref: 26 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.722310:0:23795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e15084400/0xd61f4faa13a11a8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11a84 expref: 26 pid: 22634 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.722331:0:23795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e15084400/0xd61f4faa13a11a8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11a84 expref: 25 pid: 22634 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972731.723504:0:22627:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1790972731.723540:0:22627:0:(service.c:3544:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1790972731.723564:0:22629:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1790972731.723573:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397683200 00000100:00100000:1.0:1790972731.723581:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397683200 00010000:00010000:1.0:1790972731.723612:0:22629:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e3d3cc800/0xd61f4faa13a11aca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11ac3 expref: 25 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972731.723635:0:22629:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1790972731.723643:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790972731.723651:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+25:3639:x1877970397683456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790972731.723685:0:22629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790972731.723692:0:22629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e3ad43c00/0xd61f4faa13a11a7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11a76 expref: 25 pid: 22634 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.724005:0:22628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790972731.724082:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+25:3639:x1877970397683072:12345-0@lo:103:ldlm_bl.0 Request processed in 2609us (3347us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972731.724090:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790972731.724113:0:22628:0:(service.c:3485:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1790972731.724120:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790972731.724135:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:3641:x1877970397683200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790972731.724145:0:22628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790972731.724151:0:22628:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e3d3cc800/0xd61f4faa13a11aca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd61f4faa13a11ac3 expref: 24 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.724159:0:22628:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e3d3cc800/0xd61f4faa13a11aca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11ac3 expref: 24 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.724172:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3d3cc800/0xd61f4faa13a11aca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11ac3 expref: 24 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972731.724183:0:22628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790972731.724212:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:3641:x1877970397683200:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972731.724218:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790972731.724259:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397683200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790972731.724290:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3639:1877970397683072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790972731.724737:0:23795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790972731.724790:0:23795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:3641:x1877970397683328:12345-0@lo:103:ldlm_bl.0 Request processed in 3205us (4027us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972731.724799:0:23795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790972731.724810:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397683328:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790972731.725153:0:22629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e3ad43c00/0xd61f4faa13a11a7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd61f4faa13a11a76 expref: 21 pid: 22634 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972731.725169:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3ad43c00/0xd61f4faa13a11a7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd61f4faa13a11a76 expref: 21 pid: 22634 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972731.725179:0:22629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790972731.725222:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:3639:x1877970397683456:12345-0@lo:103:ldlm_bl.0 Request processed in 1572us (4400us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972731.725229:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790972731.725289:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3639:1877970397683456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790972731.737820:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972731.738053:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972731.738126:0:25668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3adfa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25668:1877970397682304:192.168.203.39@tcp:104: 00000100:00100000:2.0:1790972731.738139:0:25668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3adfb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25668:1877970397682432:192.168.203.39@tcp:104: 00010000:00010000:2.0:1790972731.738177:0:25668:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972731.739508:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377657984 00000100:00100000:3.0:1790972731.739585:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377657984 00010000:00010000:3.0:1790972731.739628:0:22628:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e3d3cd400/0xd61f4faa13a11def lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ddb expref: 13 pid: 22636 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972731.739721:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377658112 00000100:00100000:3.0:1790972731.739726:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377658112 00010000:00010000:3.0:1790972731.739742:0:22628:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff888e3d3cd000/0xd61f4faa13a11db0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d6b expref: 14 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972731.739801:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 13 00000100:00100000:1.0:1790972731.739813:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa856691-2c52-48da-b123-663ad7a17d2e+14:2398:x1877970377657984:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790972731.739830:0:22629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1790972731.739831:0:23795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 14 00000100:00100000:0.0:1790972731.739844:0:23795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa856691-2c52-48da-b123-663ad7a17d2e+14:2398:x1877970377658112:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790972731.739855:0:22629:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e3d3cd400/0xd61f4faa13a11def lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ddb expref: 14 pid: 22636 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.739855:0:23795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972731.739864:0:23795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff888e3d3cd000/0xd61f4faa13a11db0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d6b expref: 14 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972731.739874:0:22629:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e3d3cd400/0xd61f4faa13a11def lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ddb expref: 14 pid: 22636 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.740160:0:23795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff888e3d3cd000/0xd61f4faa13a11db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d6b expref: 14 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972731.740184:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3d3cd400/0xd61f4faa13a11def lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ddb expref: 14 pid: 22636 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.740188:0:23795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3d3cd000/0xd61f4faa13a11db0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d6b expref: 14 pid: 22637 timeout: 769 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.740222:0:23795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.740230:0:23795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.740246:0:23795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.740253:0:23795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.740260:0:23795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.740267:0:23795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.740273:0:23795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad42e00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:0.0:1790972731.740277:0:23795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.740286:0:23795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972731.746177:0:22629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790972731.746197:0:25668:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972731.746212:0:25668:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972731.746328:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:aa856691-2c52-48da-b123-663ad7a17d2e+12:2398:x1877970377657984:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 6513us (8513us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972731.746339:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 13 00010000:00010000:0.0:1790972731.752221:0:23795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.752241:0:23795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff888e3ad42e00/0xd61f4faa13a11e20 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25668 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972731.752275:0:23795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790972731.752356:0:23795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08894a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:aa856691-2c52-48da-b123-663ad7a17d2e+11:2398:x1877970377658112:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 12512us (14298us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972731.752366:0:23795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 14 00010000:00010000:2.0:1790972731.957860:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790972732.980964:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790972733.242876:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972733.242982:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377658240 00000100:00100000:0.0:1790972733.242992:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377658240 00000100:00100000:0.0:1790972733.243078:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:0.0:1790972733.243089:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+6:18636:x1877970377658240:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790972733.243111:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790972733.243131:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdca00/0xd61f4faa13a11e27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e13 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243435:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e2e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243451:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243463:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243477:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e35 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243483:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243502:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243595:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd600/0xd61f4faa13a11e3c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243604:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd600/0xd61f4faa13a11e3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243611:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd600/0xd61f4faa13a11e3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790972733.243641:0:22642:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1790972733.243645:0:22642:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00080000:1.0:1790972733.243797:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:0.0:1790972733.243914:0:22642:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd600/0xd61f4faa13a11e3c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243938:0:22642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e2e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243945:0:22642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e2e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243952:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243959:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc000 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972733.243963:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e2e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243971:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e2e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.243983:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888e07716500) 00010000:00010000:0.0:1790972733.243993:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972733.243999:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.244006:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.244083:0:22642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e35 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.244089:0:22642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e35 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.244095:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.244101:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc600 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972733.244104:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e35 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.244111:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e35 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.244118:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff888e10c71b00) 00010000:00010000:0.0:1790972733.244121:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972733.244124:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e35 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.244129:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e35 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.244175:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdca00/0xd61f4faa13a11e27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e13 expref: 8 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.244384:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd600/0xd61f4faa13a11e3c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e13 expref: 7 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.244392:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff888e10c71500) 00010000:00010000:0.0:1790972733.244395:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790972733.244398:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d06bdd600, rc 0) 00000100:00100000:0.0:1790972733.244525:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+7:18636:x1877970377658240:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 1437us (1657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972733.244534:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 23 00000100:00100000:2.0:1790972733.251606:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.251699:0:22653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377658368 00000100:00100000:1.0:1790972733.251710:0:22653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377658368 00000100:00100000:1.0:1790972733.251771:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:1.0:1790972733.251781:0:22653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:528aeac5-b99c-4b0d-ae9b-e84937861361+7:18636:x1877970377658368:12345-192.168.203.39@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1790972733.252014:0:22653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:528aeac5-b99c-4b0d-ae9b-e84937861361+7:18636:x1877970377658368:12345-192.168.203.39@tcp:900:lhsmtool_posix.0 Request processed in 233us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972733.252022:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:3.0:1790972733.265550:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972733.265961:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377658624 00000100:00100000:0.0:1790972733.265972:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377658624 00000100:00100000:0.0:1790972733.266350:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:0.0:1790972733.266362:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+7:18636:x1877970377658624:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790972733.266384:0:22644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790972733.266403:0:22644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdca00/0xd61f4faa13a11e43 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e1a expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.266476:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e4a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.266984:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.266998:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.267289:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e51 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.267311:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.267319:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.267442:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdda00/0xd61f4faa13a11e58 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.267451:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdda00/0xd61f4faa13a11e58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.267458:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdda00/0xd61f4faa13a11e58 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790972733.267468:0:22644:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1790972733.268693:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e4a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.268718:0:22644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e4a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.269320:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.269327:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc600 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972733.269332:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e4a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.269341:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e4a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.269370:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff888e10c71500) 00010000:00010000:0.0:1790972733.269373:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972733.269379:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e4a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.269386:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e4a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.269402:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e51 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.269409:0:22644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e51 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.269415:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.269420:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc000 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972733.269423:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e51 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.269429:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e51 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.269436:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff888e10c71b00) 00010000:00010000:0.0:1790972733.269438:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972733.269441:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e51 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.269447:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e51 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.273415:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdca00/0xd61f4faa13a11e43 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e1a expref: 10 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.273444:0:22644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdda00/0xd61f4faa13a11e58 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e1a expref: 9 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.273454:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff888e10c71600) 00010000:00010000:0.0:1790972733.273457:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972733.273461:0:22644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d06bdda00, rc 0) 00000100:00100000:0.0:1790972733.273599:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+9:18636:x1877970377658624:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 7238us (8057us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1790972733.273608:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:0.0:1790972733.286225:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972733.286399:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377658752 00000100:00100000:3.0:1790972733.286410:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377658752 00000100:00100000:3.0:1790972733.286471:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 147 00000100:00100000:3.0:1790972733.286481:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+11:18018:x1877970377658752:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790972733.286506:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972733.286524:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888d07bb7600/0xd61f4faa13a11e66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e21 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.286551:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888d07bb7600/0xd61f4faa13a11e66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e21 expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.286563:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888d07bb7600/0xd61f4faa13a11e66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e21 expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.286573:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d07bb7600, rc 0) 00000100:00100000:3.0:1790972733.286635:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+12:18018:x1877970377658752:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 156us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.286642:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 147 00000100:00100000:2.0:1790972733.291322:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972733.291507:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377658880 00000100:00100000:3.0:1790972733.291518:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377658880 00000100:00100000:3.0:1790972733.291575:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 148 00000100:00100000:3.0:1790972733.291584:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+12:18018:x1877970377658880:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790972733.292038:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+12:18018:x1877970377658880:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 453us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.292057:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 148 00000100:00100000:2.0:1790972733.294066:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972733.294216:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377659008 00000100:00100000:0.0:1790972733.294224:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377659008 00000100:00100000:0.0:1790972733.294284:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:0.0:1790972733.294293:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+9:18636:x1877970377659008:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1790972733.294398:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+9:18636:x1877970377659008:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 Request processed in 106us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972733.294407:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 10000000:01000000:3.0:1790972733.300786:0:22639:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790972733.300794:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff888e3fa28800 from 13 10000000:01000000:3.0:1790972733.300800:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790972733.300858:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.300870:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.300882:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11e6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972733.300924:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397683584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790972733.300993:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972733.301510:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e2d595f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790972733.301648:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397683584 00000100:00100000:0.0:1790972733.301656:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397683584 00000100:00100000:0.0:1790972733.301756:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790972733.301766:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+20:22639:x1877970397683584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790972733.301780:0:22637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790972733.301804:0:22637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11e74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11e6d expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.301837:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11e6d expref: 21 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.301848:0:22637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888d06bdca00/0xd61f4faa13a11e74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11e6d expref: 21 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.301857:0:22637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d06bdca00, rc 0) 00000100:00100000:0.0:1790972733.301901:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:22639:x1877970397683584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972733.301908:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790972733.302187:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397683584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790972733.302211:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11e6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11e74 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.302220:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11e6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11e74 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972733.302281:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08950700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397683712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790972733.302313:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972733.302338:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790972733.302550:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397683712 00000100:00100000:0.0:1790972733.302555:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397683712 00000100:00100000:0.0:1790972733.302587:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790972733.302595:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:22639:x1877970397683712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790972733.302714:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41828c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:22639:x1877970397683712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (400us total) trans 0 rc 0/0 00000040:00080000:1.0:1790972733.303866:0:22676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790972733.304134:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08950700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397683712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790972733.304307:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790972733.304590:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08950700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397683840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790972733.304656:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972733.304709:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e1703d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972733.304717:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397683840 00000100:00100000:3.0:1790972733.304724:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397683840 00000100:00100000:3.0:1790972733.304763:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790972733.304772:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:22639:x1877970397683840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790972733.304887:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41829c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:22639:x1877970397683840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.304893:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790972733.304950:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08950700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397683840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790972733.305704:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.305731:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.306241:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.306271:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377659392 00000100:00100000:1.0:1790972733.306277:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377659392 00000100:00100000:1.0:1790972733.306323:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 152 00000100:00100000:1.0:1790972733.306330:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+12:18018:x1877970377659392:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790972733.306449:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377659136 00000100:00100000:0.0:1790972733.306454:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377659136 00000100:00100000:0.0:1790972733.306493:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377659264 00000100:00100000:0.0:1790972733.306496:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377659264 00000100:00100000:0.0:1790972733.306527:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:0.0:1790972733.306534:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+9:18642:x1877970377659136:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:0.0:1790972733.306554:0:23867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790972733.306573:0:23867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e28 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306630:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e82 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306645:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306656:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306751:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc200/0xd61f4faa13a11e89 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306760:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc200/0xd61f4faa13a11e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972733.306763:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41828050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+12:18018:x1877970377659392:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 433us (522us total) trans 0 rc 0/0 00010000:00010000:0.0:1790972733.306767:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc200/0xd61f4faa13a11e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972733.306770:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 152 00010000:00010000:0.0:1790972733.306797:0:23867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e82 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306804:0:23867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e82 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306810:0:23867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306816:0:23867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc600 already unused, calling callback (ffffffffc19b84f0) 00000100:00100000:1.0:1790972733.306820:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 27 00010000:00010000:0.0:1790972733.306826:0:23867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e82 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972733.306827:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+5:18636:x1877970377659264:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 00010000:00010000:0.0:1790972733.306833:0:23867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e82 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306844:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888e07716500) 00010000:00010000:0.0:1790972733.306848:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972733.306852:0:23867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306858:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc600/0xd61f4faa13a11e82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306871:0:23867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc200/0xd61f4faa13a11e89 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306878:0:23867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc200/0xd61f4faa13a11e89 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306884:0:23867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc200/0xd61f4faa13a11e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306889:0:23867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdc200 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972733.306892:0:23867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc200/0xd61f4faa13a11e89 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306897:0:23867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc200/0xd61f4faa13a11e89 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306904:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff888e10c71b00) 00010000:00010000:0.0:1790972733.306906:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972733.306925:0:23867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc200/0xd61f4faa13a11e89 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306932:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc200/0xd61f4faa13a11e89 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306963:0:23867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e7b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e28 expref: 10 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306972:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888e07716500) 00010000:00010000:0.0:1790972733.306974:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972733.306977:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc000/0xd61f4faa13a11e7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e28 expref: 10 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972733.306984:0:23867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d06bdc000, rc 0) 00000100:00100000:0.0:1790972733.307025:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+9:18642:x1877970377659136:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 491us (1328us total) trans 0 rc 301/301 00000100:00100000:0.0:1790972733.307031:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00080000:0.0:1790972733.307179:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1790972733.311493:0:25682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790972733.311912:0:22639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790972733.311945:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790972733.311957:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11e6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11e74 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.311969:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888d07bb6c00/0xd61f4faa13a11e6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11e74 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972733.311979:0:22639:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790972733.311982:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff888d05dff000 from 13 10000000:01000000:2.0:1790972733.312177:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790972733.312284:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43c00/0xd61f4faa13a11e90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.312358:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3ad43c00/0xd61f4faa13a11e90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.312382:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3ad43c00/0xd61f4faa13a11e90 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972733.312589:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08951f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397683968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790972733.312814:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972733.316105:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397683968 00000100:00100000:3.0:1790972733.316120:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397683968 00000100:00100000:3.0:1790972733.316211:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790972733.316220:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+21:22639:x1877970397683968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790972733.316238:0:22637:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972733.316255:0:22637:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888d07bb7200/0xd61f4faa13a11e97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11e90 expref: -99 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.316283:0:22637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888d07bb7200/0xd61f4faa13a11e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11e90 expref: 22 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.316305:0:22637:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888d07bb7200/0xd61f4faa13a11e97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11e90 expref: 22 pid: 22637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.316314:0:22637:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d07bb7200, rc 0) 00000100:00100000:3.0:1790972733.316384:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:22639:x1877970397683968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.316401:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790972733.316458:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972733.316481:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08951f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397683968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790972733.316498:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3ad43c00/0xd61f4faa13a11e90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11e97 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.316507:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3ad43c00/0xd61f4faa13a11e90 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11e97 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972733.316590:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790972733.316622:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972733.316645:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e2d5956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972733.316678:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397684096 00000100:00100000:3.0:1790972733.316688:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397684096 00000100:00100000:3.0:1790972733.316713:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790972733.316718:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:22639:x1877970397684096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790972733.316821:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41828850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:22639:x1877970397684096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.316840:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790972733.316871:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790972733.316898:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790972733.316947:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972733.316964:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e2d5956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972733.316974:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397684224 00000100:00100000:3.0:1790972733.316977:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397684224 00000100:00100000:3.0:1790972733.316995:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790972733.317000:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:22639:x1877970397684224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790972733.317073:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41829850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:22639:x1877970397684224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.317079:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790972733.317118:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684224:0@lo:503:ll_cfg_requeue.0 00000004:00080000:0.0:1790972733.318320:0:22643:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 10708us 00000040:00080000:3.0:1790972733.319290:0:25684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790972733.319591:0:22639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790972733.319617:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790972733.319627:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43c00/0xd61f4faa13a11e90 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11e97 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.319637:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3ad43c00/0xd61f4faa13a11e90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11e97 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972733.319647:0:22639:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790972733.319650:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff888e02880000 from 13 10000000:01000000:2.0:1790972733.319652:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790972733.319743:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11e9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.319752:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11e9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.319762:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11e9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972733.319786:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08952d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790972733.319846:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972733.319889:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972733.319912:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397684352 00000100:00100000:3.0:1790972733.319928:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397684352 00000100:00100000:3.0:1790972733.319973:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790972733.319982:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+22:22639:x1877970397684352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790972733.320005:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972733.320026:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888d07bb7c00/0xd61f4faa13a11ea5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11e9e expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.320054:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888d07bb7c00/0xd61f4faa13a11ea5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11e9e expref: 23 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.320063:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888d07bb7c00/0xd61f4faa13a11ea5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11e9e expref: 23 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.320071:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d07bb7c00, rc 0) 00000100:00100000:3.0:1790972733.320391:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:22639:x1877970397684352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 409us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.320472:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1790972733.320605:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08952d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790972733.320620:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11e9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11ea5 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.320629:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11e9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11ea5 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972733.320720:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08952d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790972733.320749:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972733.320768:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790972733.321258:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397684480 00000100:00100000:3.0:1790972733.321263:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397684480 00000100:00100000:3.0:1790972733.321349:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1790972733.321358:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:22639:x1877970397684480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790972733.321469:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:22639:x1877970397684480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.321476:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790972733.321637:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08952d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790972733.321691:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07d7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790972733.322580:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972733.322623:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e1703d300 going to sleep for 11 seconds 00000100:00100000:3.0:1790972733.322880:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397684608 00000100:00100000:3.0:1790972733.322887:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397684608 00000100:00100000:3.0:1790972733.322984:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1790972733.322995:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:22639:x1877970397684608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790972733.323110:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41829050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:22639:x1877970397684608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.323117:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790972733.323212:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07d7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790972733.325966:0:25685:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1790972733.326271:0:22639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1790972733.326450:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790972733.326462:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11e9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11ea5 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.326474:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3ad42800/0xd61f4faa13a11e9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11ea5 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790972733.326484:0:22639:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790972733.326487:0:22639:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff888e2d3c6000 from 13 10000000:01000000:2.0:1790972733.326490:0:22639:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790972733.326526:0:22639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11eac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.326534:0:22639:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11eac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.326544:0:22639:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11eac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972733.326583:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08951c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790972733.326808:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972733.326850:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1790972733.328313:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397684736 00000100:00100000:3.0:1790972733.328327:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397684736 00000100:00100000:3.0:1790972733.328392:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1790972733.328401:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+23:22639:x1877970397684736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790972733.328417:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972733.328433:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888d07bb6200/0xd61f4faa13a11eb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd61f4faa13a11eac expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.328459:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888d07bb6200/0xd61f4faa13a11eb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd61f4faa13a11eac expref: 24 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.328470:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888d07bb6200/0xd61f4faa13a11eb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd61f4faa13a11eac expref: 24 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.328479:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d07bb6200, rc 0) 00000100:00100000:3.0:1790972733.328543:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41828450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:22639:x1877970397684736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (1735us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.328550:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790972733.328988:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972733.329039:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08951c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790972733.329041:0:22651:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377659520 00000100:00100000:0.0:1790972733.329053:0:22651:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377659520 00010000:00010000:2.0:1790972733.329059:0:22639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11eac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11eb3 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.329071:0:22639:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11eac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd61f4faa13a11eb3 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972733.329093:0:22651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:0.0:1790972733.329103:0:22651:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:528aeac5-b99c-4b0d-ae9b-e84937861361+9:18642:x1877970377659520:12345-192.168.203.39@tcp:700:lfs.0 00000100:00100000:2.0:1790972733.329145:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08951c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790972733.329178:0:22651:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:528aeac5-b99c-4b0d-ae9b-e84937861361+9:18642:x1877970377659520:12345-192.168.203.39@tcp:700:lfs.0 Request processed in 76us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972733.329184:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972733.329200:0:22651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:2.0:1790972733.329217:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1790972733.329616:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397684864 00000100:00100000:3.0:1790972733.329622:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397684864 00000100:00100000:3.0:1790972733.329945:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1790972733.329953:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e41829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:22639:x1877970397684864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790972733.330069:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e41829450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:22639:x1877970397684864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.330077:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790972733.330157:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08951c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790972733.330196:0:22639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08951c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790972733.330241:0:22639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972733.330272:0:22639:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e09b5ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1790972733.330332:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397684992 00000100:00100000:3.0:1790972733.330336:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397684992 00000100:00100000:3.0:1790972733.330397:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1790972733.330404:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:22639:x1877970397684992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790972733.330479:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:22639:x1877970397684992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.330492:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790972733.330555:0:22639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08951c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:22639:1877970397684992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790972733.331278:0:25686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1790972733.331574:0:22639:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1790972733.331596:0:22639:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.139@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790972733.331606:0:22639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11eac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11eb3 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.331616:0:22639:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.139@tcp lock: ffff888e3ad43800/0xd61f4faa13a11eac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd61f4faa13a11eb3 expref: -99 pid: 22639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972733.334355:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972733.334434:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.338589:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377659904 00000100:00100000:1.0:1790972733.338605:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377659904 00000100:00100000:1.0:1790972733.338695:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 162 00000100:00100000:1.0:1790972733.338706:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+12:18018:x1877970377659904:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790972733.339281:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972733.339300:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff888e1d1eb600/0xd61f4faa13a11eba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e2f expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.339329:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff888e1d1eb600/0xd61f4faa13a11eba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e2f expref: 13 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.339339:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff888e1d1eb600/0xd61f4faa13a11eba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e2f expref: 13 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.339354:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1eb600, rc 0) 00000100:00100000:1.0:1790972733.339428:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+13:18018:x1877970377659904:12345-192.168.203.39@tcp:101:ll_cfg_requeue.0 Request processed in 724us (4993us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972733.339436:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 162 00000100:00100000:1.0:1790972733.339481:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377659776 00000100:00100000:0.0:1790972733.340016:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+5:18636:x1877970377659264:12345-192.168.203.39@tcp:59:lhsmtool_posix.0 Request processed in 33187us (34281us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972733.340024:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 27 00000100:00100000:1.0:1790972733.340603:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377659776 00000100:00100000:1.0:1790972733.340679:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:1.0:1790972733.340687:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+9:18642:x1877970377659776:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:1.0:1790972733.341299:0:23867:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790972733.341329:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdce00/0xd61f4faa13a11dda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1d9c expref: 9 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.341348:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888e07716500) 00010000:00010000:1.0:1790972733.341354:0:23867:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790972733.341419:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.341434:0:23867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7a00/0xd61f4faa13a11e19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e0c expref: 5 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.341443:0:23867:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.341474:0:23867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7a00/0xd61f4faa13a11e19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e0c expref: 5 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.342317:0:23867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7a00/0xd61f4faa13a11e19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e0c expref: 5 pid: 22643 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972733.342348:0:23867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08895500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23867:1877970397685120:192.168.203.39@tcp:104: 00000100:00100000:1.0:1790972733.342436:0:23867:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e0774ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1790972733.349361:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.349574:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377660032 00000100:00100000:1.0:1790972733.349584:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377660032 00000100:00100000:1.0:1790972733.349641:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 163 00000100:00100000:1.0:1790972733.349651:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e4182b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+13:18018:x1877970377660032:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790972733.352022:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e4182b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:aa856691-2c52-48da-b123-663ad7a17d2e+13:18018:x1877970377660032:12345-192.168.203.39@tcp:501:ll_cfg_requeue.0 Request processed in 2364us (2661us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972733.352037:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 163 00000100:00100000:0.0:1790972733.356615:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972733.357729:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972733.357759:0:22636:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377660288 00000100:00100000:2.0:1790972733.357768:0:22636:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377660288 00000100:00100000:2.0:1790972733.357826:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 164 00000100:00100000:2.0:1790972733.357836:0:22636:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+13:18018:x1877970377660288:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790972733.357988:0:22636:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a746850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:aa856691-2c52-48da-b123-663ad7a17d2e+13:18018:x1877970377660288:12345-192.168.203.39@tcp:503:ll_cfg_requeue.0 Request processed in 153us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972733.357997:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 164 00000100:00100000:3.0:1790972733.357998:0:25670:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377660160 00000100:00100000:3.0:1790972733.358003:0:25670:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377660160 00010000:00010000:3.0:1790972733.358035:0:25670:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7a00/0xd61f4faa13a11e19 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e0c expref: 6 pid: 22643 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972733.358075:0:25670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:3.0:1790972733.358092:0:25670:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7e7e985b-53ac-495e-afad-1d490636b4f4+6:2398:x1877970377660160:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790972733.358107:0:25670:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790972733.358117:0:25670:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7a00/0xd61f4faa13a11e19 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e0c expref: 6 pid: 22643 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.358128:0:25670:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7a00/0xd61f4faa13a11e19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e0c expref: 6 pid: 22643 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.358151:0:25670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888e07716500) 00010000:00010000:3.0:1790972733.358157:0:25670:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.358165:0:25670:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.358172:0:25670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.358190:0:25670:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790972733.358215:0:25670:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7e7e985b-53ac-495e-afad-1d490636b4f4+6:2398:x1877970377660160:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 133us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.358231:0:25670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00010000:00010000:1.0:1790972733.358379:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7a00/0xd61f4faa13a11e19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e0c expref: 5 pid: 22643 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972733.358396:0:23867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08895500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23867:1877970397685120:192.168.203.39@tcp:104: 00010000:00010000:1.0:1790972733.358416:0:23867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.358425:0:23867:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.358431:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.358455:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea800/0xd61f4faa13a11ec8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.358465:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea800/0xd61f4faa13a11ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.358480:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea800/0xd61f4faa13a11ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790972733.359658:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790972733.360508:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a11ecf lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.360527:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a11ecf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.360535:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a11ecf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790972733.360550:0:23867:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c0a9f526 reply state 000000003ce0a65b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a11ecf lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.360560:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a11ecf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.360566:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff888e08b6f500) 00010000:00010000:1.0:1790972733.360569:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790972733.360573:0:23867:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790972733.360578:0:23867:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790972733.360585:0:23867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.360593:0:23867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.360599:0:23867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.360603:0:23867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eb000 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:1.0:1790972733.360614:0:23867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.360622:0:23867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.360631:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888e07716500) 00010000:00010000:1.0:1790972733.360634:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790972733.360637:0:23867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.360644:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11ec1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790972733.360684:0:23867:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c0a9f526 reply state 000000003ce0a65b transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea800/0xd61f4faa13a11ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.360693:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea800/0xd61f4faa13a11ec8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.360699:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff888e08b6fb00) 00010000:00010000:1.0:1790972733.360701:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790972733.360703:0:23867:0:(service.c:197:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1790972733.361021:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+10:18642:x1877970377659776:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 20331us (26671us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1790972733.361031:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 28 00000100:00100000:1.0:1790972733.452550:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972733.452704:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377660416 00000100:00100000:2.0:1790972733.452714:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377660416 00000100:00100000:2.0:1790972733.452764:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:2.0:1790972733.452773:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+10:18652:x1877970377660416:12345-192.168.203.39@tcp:101:lctl.0 00010000:00010000:2.0:1790972733.452796:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972733.452818:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ed6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e36 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.452895:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42600/0xd61f4faa13a11edd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.452908:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42600/0xd61f4faa13a11edd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.452929:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42600/0xd61f4faa13a11edd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790972733.452978:0:22642:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790972733.452982:0:22642:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790972733.453034:0:22642:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42600/0xd61f4faa13a11edd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.453234:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ed6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e36 expref: 12 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.453255:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42600/0xd61f4faa13a11edd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e36 expref: 11 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.453280:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888d06e3ba00) 00010000:00010000:2.0:1790972733.453283:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790972733.453286:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad42600, rc 0) 00000100:00100000:2.0:1790972733.453361:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+11:18652:x1877970377660416:12345-192.168.203.39@tcp:101:lctl.0 Request processed in 588us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972733.453368:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 29 00000100:00100000:2.0:1790972733.490634:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972733.490775:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377660544 00000100:00100000:3.0:1790972733.490785:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377660544 00000100:00100000:3.0:1790972733.490846:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:3.0:1790972733.490855:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7e7e985b-53ac-495e-afad-1d490636b4f4+5:18653:x1877970377660544:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1790972733.490877:0:22644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972733.490898:0:22644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11ee4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e3d expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.490968:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6e00/0xd61f4faa13a11eeb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.490982:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6e00/0xd61f4faa13a11eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.490993:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6e00/0xd61f4faa13a11eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790972733.491039:0:22644:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790972733.491043:0:22644:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790972733.491070:0:22644:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6e00/0xd61f4faa13a11eeb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.491096:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11ee4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e3d expref: 7 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.491113:0:22644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6e00/0xd61f4faa13a11eeb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e3d expref: 6 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.491139:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888d06e3ba00) 00010000:00010000:3.0:1790972733.491142:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790972733.491145:0:22644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d07bb6e00, rc 0) 00000100:00100000:3.0:1790972733.491200:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7e7e985b-53ac-495e-afad-1d490636b4f4+6:18653:x1877970377660544:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 346us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.491206:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 30 00000100:00100000:1.0:1790972733.498577:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972733.499657:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377660672 00000100:00100000:2.0:1790972733.499694:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377660672 00000100:00100000:2.0:1790972733.499748:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:2.0:1790972733.499758:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+6:18653:x1877970377660672:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:2.0:1790972733.499778:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972733.499797:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ef2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e44 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.499870:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ef9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.499883:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.499894:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.499905:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.499912:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.499952:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500032:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42e00/0xd61f4faa13a11f07 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500040:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42e00/0xd61f4faa13a11f07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500047:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42e00/0xd61f4faa13a11f07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790972733.500090:0:22642:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1790972733.500094:0:22642:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790972733.500114:0:22642:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42e00/0xd61f4faa13a11f07 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500127:0:22642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ef9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500134:0:22642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ef9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500141:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500146:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad42400 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:2.0:1790972733.500151:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ef9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500159:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ef9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500178:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888d06e3ba00) 00010000:00010000:2.0:1790972733.500181:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790972733.500187:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ef9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500193:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ef9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500206:0:22642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500213:0:22642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500219:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500223:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad43000 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:2.0:1790972733.500226:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500232:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500239:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff888e08b6fb00) 00010000:00010000:2.0:1790972733.500241:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790972733.500244:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500249:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500286:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ef2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e44 expref: 8 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500298:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42e00/0xd61f4faa13a11f07 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e44 expref: 7 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.500305:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff888e08b6f500) 00010000:00010000:2.0:1790972733.500307:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790972733.500310:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad42e00, rc 0) 00000100:00100000:2.0:1790972733.500388:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+7:18653:x1877970377660672:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 631us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972733.500396:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 31 00000100:00100000:3.0:1790972733.504890:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.505280:0:22653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377660800 00000100:00100000:1.0:1790972733.505290:0:22653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377660800 00000100:00100000:1.0:1790972733.505362:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:1.0:1790972733.505386:0:22653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7e7e985b-53ac-495e-afad-1d490636b4f4+5:18653:x1877970377660800:12345-192.168.203.39@tcp:900:lfs.0 00000100:00100000:1.0:1790972733.505468:0:22653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7e7e985b-53ac-495e-afad-1d490636b4f4+5:18653:x1877970377660800:12345-192.168.203.39@tcp:900:lfs.0 Request processed in 84us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972733.505476:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00080000:2.0:1790972733.506100:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1790972733.508372:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.508476:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377661056 00000100:00100000:1.0:1790972733.508487:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377661056 00000100:00100000:1.0:1790972733.508552:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:1.0:1790972733.508563:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7e7e985b-53ac-495e-afad-1d490636b4f4+7:18653:x1877970377661056:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1790972733.508583:0:22644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972733.508601:0:22644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a11f0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e4b expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790972733.508850:0:22644:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790972733.508959:0:22644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a11f0e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e4b expref: 9 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.508975:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888d06e3ba00) 00010000:00010000:1.0:1790972733.508978:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790972733.508983:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a11f0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e4b expref: 9 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.508997:0:22644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1eb200, rc 0) 00000100:00100000:1.0:1790972733.509051:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7e7e985b-53ac-495e-afad-1d490636b4f4+8:18653:x1877970377661056:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 490us (688us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1790972733.509058:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 32 00000100:00100000:1.0:1790972733.517343:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972733.519152:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377661312 00000100:00100000:2.0:1790972733.519170:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377661312 00000100:00100000:3.0:1790972733.519872:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:3.0:1790972733.519897:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e07da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+8:18653:x1877970377661312:12345-192.168.203.39@tcp:36:lfs.0 00010000:00010000:3.0:1790972733.519963:0:22642:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790972733.519989:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42e00/0xd61f4faa13a11f07 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e44 expref: 8 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.520009:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff888e08b6f500) 00010000:00010000:3.0:1790972733.520012:0:22642:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790972733.520033:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11f1c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.520046:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11f1c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.520054:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11f1c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790972733.520237:0:22642:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cc15db59 reply state 000000008f9762ba transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11f1c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.520270:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11f1c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.520276:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff888e08b6f500) 00010000:00010000:3.0:1790972733.520279:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1790972733.520282:0:22642:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1790972733.520290:0:22642:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1790972733.520392:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e07da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+9:18653:x1877970377661312:12345-192.168.203.39@tcp:36:lfs.0 Request processed in 509us (3056us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1790972733.520400:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 33 00000100:00100000:3.0:1790972733.539126:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972733.539238:0:22646:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377661568 00000100:00100000:2.0:1790972733.539249:0:22646:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377661568 00000100:00100000:2.0:1790972733.539308:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:2.0:1790972733.539317:0:22646:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+9:18653:x1877970377661568:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1790972733.539544:0:22646:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+10:18653:x1877970377661568:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 227us (429us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1790972733.539553:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:2.0:1790972733.547641:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.547846:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377661824 00000100:00100000:1.0:1790972733.547870:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377661824 00000100:00100000:1.0:1790972733.547934:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 34 00000100:00100000:1.0:1790972733.547944:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7e7e985b-53ac-495e-afad-1d490636b4f4+10:18653:x1877970377661824:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1790972733.547969:0:22644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972733.547991:0:22644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a11f23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e52 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548061:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548074:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548086:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548097:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11f31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548105:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548111:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790972733.548360:0:22644:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790972733.548430:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548439:0:22644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f2a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548458:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548464:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1ebe00 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:1.0:1790972733.548468:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548478:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548489:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888d06e3ba00) 00010000:00010000:1.0:1790972733.548492:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790972733.548496:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548502:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548516:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548521:0:22644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11f31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548526:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11f31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548531:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eb000 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:1.0:1790972733.548533:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11f31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548548:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11f31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548566:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff888e08b6fb00) 00010000:00010000:1.0:1790972733.548569:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790972733.548572:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11f31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548577:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11f31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548617:0:22644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a11f23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e52 expref: 12 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548634:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888d06e3ba00) 00010000:00010000:1.0:1790972733.548636:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790972733.548640:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a11f23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e52 expref: 12 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.548656:0:22644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1eb200, rc 0) 00000100:00100000:1.0:1790972733.549099:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7e7e985b-53ac-495e-afad-1d490636b4f4+11:18653:x1877970377661824:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1154us (1465us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1790972733.549106:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 34 00000040:00080000:2.0:1790972733.558985:0:23395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790972733.573592:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972733.574966:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377661952 00000100:00100000:3.0:1790972733.574981:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377661952 00000100:00100000:3.0:1790972733.575048:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:3.0:1790972733.575059:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e07da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+11:18653:x1877970377661952:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1790972733.575085:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972733.575106:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a11f3f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e59 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.575945:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11f46 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.575965:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11f46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.575977:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11f46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790972733.576010:0:22642:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790972733.576026:0:22642:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790972733.576051:0:22642:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11f46 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.576081:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a11f3f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e59 expref: 13 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.576097:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11f46 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e59 expref: 12 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.576107:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff888e08b6f500) 00010000:00010000:3.0:1790972733.576110:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790972733.576113:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d07bb6800, rc 0) 00000100:00100000:3.0:1790972733.576184:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e07da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+12:18653:x1877970377661952:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 1127us (2602us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.577373:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 35 00000100:00100000:0.0:1790972733.587037:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972733.587125:0:22646:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377662080 00000100:00100000:2.0:1790972733.587135:0:22646:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377662080 00000100:00100000:2.0:1790972733.587203:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:2.0:1790972733.587212:0:22646:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+12:18653:x1877970377662080:12345-192.168.203.39@tcp:37:lfs.0 00000100:00100000:1.0:1790972733.599473:0:22646:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+12:18653:x1877970377662080:12345-192.168.203.39@tcp:37:lfs.0 Request processed in 12252us (12434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972733.599486:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 3 00000100:00100000:2.0:1790972733.602589:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972733.602693:0:22645:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377662336 00000100:00100000:0.0:1790972733.602713:0:22645:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377662336 00000100:00100000:0.0:1790972733.602774:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:0.0:1790972733.602785:0:22645:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05013c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+12:18653:x1877970377662336:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1790972733.603030:0:22645:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05013c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7e7e985b-53ac-495e-afad-1d490636b4f4+13:18653:x1877970377662336:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 246us (449us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1790972733.603037:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 4 00000100:00100000:2.0:1790972733.686751:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972733.687224:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377662464 00000100:00100000:3.0:1790972733.687234:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377662464 00000100:00100000:3.0:1790972733.687425:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:3.0:1790972733.687436:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+11:18659:x1877970377662464:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:3.0:1790972733.687457:0:22644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972733.687475:0:22644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a11f4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e60 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687548:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11f54 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687562:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687591:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687604:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11f5b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687612:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687619:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687714:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7000/0xd61f4faa13a11f62 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687723:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7000/0xd61f4faa13a11f62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687730:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7000/0xd61f4faa13a11f62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790972733.687764:0:22644:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1790972733.687768:0:22644:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1790972733.687806:0:22644:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7000/0xd61f4faa13a11f62 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687818:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11f54 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687825:0:22644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11f54 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687841:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11f54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687848:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb7400 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:3.0:1790972733.687851:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11f54 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687859:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11f54 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.687871:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888d06e3ba00) 00010000:00010000:3.0:1790972733.687874:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790972733.687879:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11f54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.688056:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11f54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.688070:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11f5b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.688076:0:22644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11f5b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.688082:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11f5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.688088:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb6400 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:3.0:1790972733.688102:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11f5b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.688119:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11f5b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.688128:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff888e08b6fb00) 00010000:00010000:3.0:1790972733.688131:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790972733.688134:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11f5b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.688140:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11f5b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.688167:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a11f4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e60 expref: 13 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.688180:0:22644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7000/0xd61f4faa13a11f62 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e60 expref: 12 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.688188:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff888e08b6f500) 00010000:00010000:3.0:1790972733.688190:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790972733.688193:0:22644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d07bb7000, rc 0) 00000100:00100000:3.0:1790972733.688402:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+12:18659:x1877970377662464:12345-192.168.203.39@tcp:101:bash.0 Request processed in 966us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972733.688411:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 36 00000100:00100000:3.0:1790972733.688443:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790972733.688458:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397685248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790972733.688570:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972733.689462:0:24151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397685248 00000100:00100000:0.0:1790972733.689471:0:24151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397685248 00000100:00100000:0.0:1790972733.689648:0:24151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1790972733.689652:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790972733.689658:0:24151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397685248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790972733.689728:0:24151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790972733.689787:0:24151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1877970397685248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972733.689794:0:24151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790972733.690103:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3638:1877970397685248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790972733.703146:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.704424:0:22653:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377662592 00000100:00100000:1.0:1790972733.704438:0:22653:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377662592 00000100:00100000:1.0:1790972733.704516:0:22653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:1.0:1790972733.704526:0:22653:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:528aeac5-b99c-4b0d-ae9b-e84937861361+5:18659:x1877970377662592:12345-192.168.203.39@tcp:900:bash.0 00000100:00100000:1.0:1790972733.704634:0:22653:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:528aeac5-b99c-4b0d-ae9b-e84937861361+5:18659:x1877970377662592:12345-192.168.203.39@tcp:900:bash.0 Request processed in 111us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972733.704643:0:22653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1790972733.707209:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.707299:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377662848 00000100:00100000:1.0:1790972733.707308:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377662848 00000100:00100000:1.0:1790972733.707370:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:1.0:1790972733.707379:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+12:18659:x1877970377662848:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1790972733.707399:0:22643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972733.707419:0:22643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11f69 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e67 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.707529:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.707545:0:22643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11f46 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e59 expref: 12 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.707554:0:22643:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.707795:0:22643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11f46 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e59 expref: 12 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.707810:0:22643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11f46 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e59 expref: 12 pid: 22642 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972733.707839:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22643:1877970397685376:192.168.203.39@tcp:104: 00000100:00100000:1.0:1790972733.707932:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e0774c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790972733.729185:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22643:1877970397685376:192.168.203.39@tcp:104: 00010000:00010000:1.0:1790972733.729215:0:22643:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972733.732427:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.732872:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377662976 00000100:00100000:1.0:1790972733.732882:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377662976 00010000:00010000:1.0:1790972733.732942:0:22628:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11f46 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e59 expref: 13 pid: 22642 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972733.732988:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:1.0:1790972733.732996:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08951880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+13:2398:x1877970377662976:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790972733.733011:0:22628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790972733.733018:0:22628:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11f46 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e59 expref: 13 pid: 22642 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.733029:0:22628:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11f46 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e59 expref: 13 pid: 22642 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.733049:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6800/0xd61f4faa13a11f46 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e59 expref: 13 pid: 22642 timeout: 771 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.733065:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff888e08b6f500) 00010000:00010000:1.0:1790972733.733070:0:22628:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.733093:0:22628:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.733102:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.733134:0:22628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790972733.733879:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08951880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+12:2398:x1877970377662976:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 880us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972733.733888:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00010000:00010000:2.0:1790972733.734234:0:22643:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.734244:0:22643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.734320:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f77 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.734331:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f77 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.734340:0:22643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f77 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735015:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11f7e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735028:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11f7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735035:0:22643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11f7e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790972733.735045:0:22643:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790972733.735083:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735091:0:22643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735098:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735103:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1ebe00 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:2.0:1790972733.735108:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735116:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735127:0:22643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff888e08b6f500) 00010000:00010000:2.0:1790972733.735130:0:22643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790972733.735134:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735141:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ebe00/0xd61f4faa13a11f70 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790972733.735152:0:22643:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008e2fc080 reply state 00000000a6caf308 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f77 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735162:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f77 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735169:0:22643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff888d06e3b000) 00010000:00010000:2.0:1790972733.735171:0:22643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790972733.735179:0:22643:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790972733.735214:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb000/0xd61f4faa13a11f69 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e67 expref: 15 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735229:0:22643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11f7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e67 expref: 14 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972733.735236:0:22643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:2.0:1790972733.735238:0:22643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1790972733.735240:0:22643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad42a00, rc 0) 00000100:00100000:2.0:1790972733.735294:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+15:18659:x1877970377662848:12345-192.168.203.39@tcp:101:bash.0 Request processed in 27916us (28094us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1790972733.735301:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 37 00000100:00100000:2.0:1790972733.761897:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.762000:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377663104 00000100:00100000:1.0:1790972733.762009:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377663104 00000100:00100000:1.0:1790972733.762069:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:1.0:1790972733.762079:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+15:18659:x1877970377663104:12345-192.168.203.39@tcp:101:bash.0 00010000:00010000:1.0:1790972733.762102:0:23867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972733.762122:0:23867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a11f8c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e6e expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.762187:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.762202:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.762214:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790972733.762259:0:23867:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790972733.762263:0:23867:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790972733.762297:0:23867:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.762308:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.762333:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a11f8c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e6e expref: 17 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.762354:0:23867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e6e expref: 16 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.762363:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:1.0:1790972733.762366:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790972733.762369:0:23867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1eb800, rc 0) 00000100:00100000:1.0:1790972733.762575:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+16:18659:x1877970377663104:12345-192.168.203.39@tcp:101:bash.0 Request processed in 496us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972733.762583:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 38 00000100:00100000:2.0:1790972733.778304:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972733.781279:0:22645:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377663360 00000100:00100000:0.0:1790972733.781294:0:22645:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377663360 00000100:00100000:0.0:1790972733.781373:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:0.0:1790972733.781384:0:22645:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+16:18659:x1877970377663360:12345-192.168.203.39@tcp:35:bash.0 00000100:00100000:0.0:1790972733.781759:0:22645:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+17:18659:x1877970377663360:12345-192.168.203.39@tcp:35:bash.0 Request processed in 376us (3463us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1790972733.781769:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 5 00000100:00100000:2.0:1790972733.896656:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.897145:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377663616 00000100:00100000:1.0:1790972733.897156:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377663616 00000100:00100000:1.0:1790972733.897219:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:1.0:1790972733.897229:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+17:18669:x1877970377663616:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:1.0:1790972733.897254:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972733.897277:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11f9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e75 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790972733.897375:0:22642:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1790972733.897474:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11f9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e75 expref: 19 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.897505:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff888d06e3ba00) 00010000:00010000:1.0:1790972733.897508:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790972733.897513:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11f9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e75 expref: 19 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.897526:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1eb400, rc 0) 00000100:00100000:1.0:1790972733.897780:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+18:18669:x1877970377663616:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 552us (1133us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1790972733.897788:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 39 00000100:00100000:1.0:1790972733.902150:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972733.902272:0:22645:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377663872 00000100:00100000:0.0:1790972733.902285:0:22645:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377663872 00000100:00100000:0.0:1790972733.902346:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:0.0:1790972733.902355:0:22645:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e07da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+18:18669:x1877970377663872:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:0.0:1790972733.902861:0:22645:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e07da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+19:18669:x1877970377663872:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 505us (719us total) trans 12884901899 rc 0/0 00000100:00100000:0.0:1790972733.902869:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 6 00000100:00100000:2.0:1790972733.952652:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972733.953048:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377664128 00000100:00100000:3.0:1790972733.953060:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377664128 00000100:00100000:3.0:1790972733.953124:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:3.0:1790972733.953135:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+19:18672:x1877970377664128:12345-192.168.203.39@tcp:101:lfs.0 00010000:00010000:3.0:1790972733.953157:0:22644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972733.953176:0:22644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a11fa8 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e7c expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.953278:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11faf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.953294:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11faf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.953305:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11faf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790972733.953316:0:22644:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790972733.953432:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a11fa8 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e7c expref: 22 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.953450:0:22644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11faf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e7c expref: 21 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972733.953459:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:3.0:1790972733.953461:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790972733.953465:0:22644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d07bb6400, rc 0) 00000100:00100000:3.0:1790972733.953532:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08952300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+21:18672:x1877970377664128:12345-192.168.203.39@tcp:101:lfs.0 Request processed in 399us (900us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1790972733.953564:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 40 00000100:00100000:2.0:1790972733.959798:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.960022:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377664256 00000100:00100000:1.0:1790972733.960033:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377664256 00000100:00100000:1.0:1790972733.960092:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:1.0:1790972733.960101:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+21:18672:x1877970377664256:12345-192.168.203.39@tcp:54:lfs.0 00010000:00010000:1.0:1790972733.960167:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fbd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.960184:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.960195:0:22643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.960227:0:22643:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fbd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.960233:0:22643:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fbd lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.960253:0:22643:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fbd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.960260:0:22643:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eb400 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:1.0:1790972733.960264:0:22643:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fbd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.960273:0:22643:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fbd lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.960285:0:22643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:1.0:1790972733.960288:0:22643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790972733.960293:0:22643:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fbd lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.960300:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fbd lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972733.960382:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+21:18672:x1877970377664256:12345-192.168.203.39@tcp:54:lfs.0 Request processed in 281us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972733.960390:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 41 00000100:00100000:2.0:1790972733.962765:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972733.962972:0:23795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377664384 00000100:00100000:1.0:1790972733.962983:0:23795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377664384 00000100:00100000:1.0:1790972733.963048:0:23795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:1.0:1790972733.963058:0:23795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08952d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+21:2399:x1877970377664384:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790972733.963074:0:23795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790972733.963099:0:23795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6400/0xd61f4faa13a11faf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e7c expref: 21 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972733.963141:0:23795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:1.0:1790972733.963146:0:23795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790972733.963208:0:23795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08952d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+20:2399:x1877970377664384:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 151us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972733.963215:0:23795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:3.0:1790972733.966035:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972733.966128:0:22646:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377664640 00000100:00100000:2.0:1790972733.966140:0:22646:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377664640 00000100:00100000:2.0:1790972733.966202:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 7 00000100:00100000:2.0:1790972733.966212:0:22646:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+20:18672:x1877970377664640:12345-192.168.203.39@tcp:35:lfs.0 00000100:00100000:2.0:1790972733.966434:0:22646:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+21:18672:x1877970377664640:12345-192.168.203.39@tcp:35:lfs.0 Request processed in 223us (409us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1790972733.966441:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 7 00010000:00010000:2.0:1790972734.008096:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790972734.277051:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972734.277658:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377664896 00000100:00100000:3.0:1790972734.277692:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377664896 00000100:00100000:3.0:1790972734.277759:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:3.0:1790972734.277770:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+21:18703:x1877970377664896:12345-192.168.203.39@tcp:101:cat.0 00010000:00010000:3.0:1790972734.277794:0:22644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790972734.277817:0:22644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a11fc4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e83 expref: -99 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972734.278273:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11fcb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972734.278288:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11fcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972734.278300:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11fcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790972734.278311:0:22644:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1790972734.278441:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a11fc4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e83 expref: 24 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972734.278460:0:22644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11fcb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e83 expref: 23 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972734.278469:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:3.0:1790972734.278472:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790972734.278485:0:22644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d07bb7400, rc 0) 00000100:00100000:3.0:1790972734.278764:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+23:18703:x1877970377664896:12345-192.168.203.39@tcp:101:cat.0 Request processed in 995us (2141us total) trans 12884901902 rc 0/0 00000100:00100000:3.0:1790972734.278774:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 42 00000100:00100000:1.0:1790972734.289407:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972734.289464:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972734.289546:0:22646:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377665152 00000100:00100000:3.0:1790972734.289555:0:22646:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377665152 00000100:00100000:3.0:1790972734.289610:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:3.0:1790972734.289621:0:22646:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e07da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+23:18703:x1877970377665152:12345-192.168.203.39@tcp:35:cat.0 00000100:00100000:3.0:1790972734.289990:0:22646:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e07da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+24:18703:x1877970377665152:12345-192.168.203.39@tcp:35:cat.0 Request processed in 369us (525us total) trans 12884901903 rc 0/0 00000100:00100000:3.0:1790972734.289999:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 8 00000100:00100000:2.0:1790972734.290297:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377665280 00000100:00100000:2.0:1790972734.290303:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377665280 00000100:00100000:2.0:1790972734.290349:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:2.0:1790972734.290358:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e07da3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+24:2397:x1877970377665280:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790972734.290370:0:22627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790972734.290393:0:22627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7400/0xd61f4faa13a11fcb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e83 expref: 24 pid: 22644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.290411:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:2.0:1790972734.290415:0:22627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790972734.290439:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e07da3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+23:2397:x1877970377665280:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 83us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972734.290446:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:2.0:1790972734.361547:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972734.361656:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377665536 00000100:00100000:1.0:1790972734.361698:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377665536 00000100:00100000:1.0:1790972734.361758:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:1.0:1790972734.361768:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+23:18709:x1877970377665536:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1790972734.361794:0:22643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972734.361815:0:22643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eac00/0xd61f4faa13a11fd9 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e8a expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.361942:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fe0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.361957:0:22643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11f7e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e67 expref: 24 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.361966:0:22643:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e6e expref: 24 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.361974:0:22643:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fe0 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.362023:0:22643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e6e expref: 24 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.362036:0:22643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e6e expref: 24 pid: 23867 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972734.362050:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22643:1877970397685504:192.168.203.39@tcp:104: 00010000:00010000:1.0:1790972734.362157:0:22643:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11f7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e67 expref: 24 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.362166:0:22643:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11f7e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e67 expref: 24 pid: 22643 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972734.362175:0:22643:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22643:1877970397685632:192.168.203.39@tcp:104: 00000100:00100000:1.0:1790972734.362198:0:22643:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e0774c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790972734.369784:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972734.369837:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972734.370013:0:23795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377665792 00000100:00100000:0.0:1790972734.370022:0:23795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377665792 00000100:00100000:2.0:1790972734.370035:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22643:1877970397685504:192.168.203.39@tcp:104: 00000100:00100000:2.0:1790972734.370047:0:22643:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da3480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22643:1877970397685632:192.168.203.39@tcp:104: 00010000:00010000:0.0:1790972734.370062:0:23795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11f7e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e67 expref: 25 pid: 22643 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.370078:0:22643:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fe0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972734.370100:0:23795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377665664 00000100:00100000:0.0:1790972734.370104:0:23795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377665664 00010000:00010000:0.0:1790972734.370116:0:23795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e6e expref: 26 pid: 23867 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972734.370176:0:23795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:0.0:1790972734.370186:0:23795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e07da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+26:2398:x1877970377665792:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790972734.370208:0:23795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972734.370215:0:23795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11f7e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e67 expref: 26 pid: 22643 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972734.370226:0:23795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11f7e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e67 expref: 26 pid: 22643 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972734.370248:0:23795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11f7e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e67 expref: 26 pid: 22643 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972734.370260:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 18 00010000:00010000:0.0:1790972734.370270:0:23795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00000100:00100000:3.0:1790972734.370271:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07dfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+25:2398:x1877970377665664:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790972734.370275:0:23795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fe0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972734.370278:0:22628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790972734.370283:0:22628:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e6e expref: 25 pid: 23867 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972734.370284:0:23795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fe0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972734.370291:0:23795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790972734.370294:0:22628:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e6e expref: 25 pid: 23867 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972734.370306:0:22628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a11f93 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e6e expref: 25 pid: 23867 timeout: 772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972734.370315:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:3.0:1790972734.370317:0:22628:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fe0 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972734.370335:0:22628:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fe0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972734.370342:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fe0 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972734.370344:0:23795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e07da0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+24:2398:x1877970377665792:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 159us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972734.370351:0:23795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00010000:00010000:3.0:1790972734.370361:0:22628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790972734.370445:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07dfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+23:2398:x1877970377665664:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 114us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972734.370453:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 18 00010000:00010000:2.0:1790972734.371482:0:22643:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fe0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.371495:0:22643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fe0 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790972734.371513:0:22643:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790972734.371722:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eac00/0xd61f4faa13a11fd9 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e8a expref: 24 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.371758:0:22643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb400/0xd61f4faa13a11fe0 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e8a expref: 23 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.371766:0:22643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:2.0:1790972734.371768:0:22643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790972734.371771:0:22643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1eb400, rc 0) 00000100:00100000:2.0:1790972734.371821:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+23:18709:x1877970377665536:12345-192.168.203.39@tcp:101:dd.0 Request processed in 10054us (10282us total) trans 12884901904 rc 0/0 00000100:00100000:2.0:1790972734.371829:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 43 00000100:00100000:1.0:1790972734.374207:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972734.374285:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377665920 00000100:00100000:2.0:1790972734.374296:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377665920 00000100:00100000:2.0:1790972734.374361:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:2.0:1790972734.374372:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e07da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+23:18709:x1877970377665920:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1790972734.374401:0:23867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972734.374423:0:23867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42e00/0xd61f4faa13a11fee lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e91 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.374462:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ff5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.374476:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ff5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.374487:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ff5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.374615:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42e00/0xd61f4faa13a11fee lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e91 expref: 25 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.374654:0:23867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ff5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e91 expref: 24 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.374862:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:2.0:1790972734.374866:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1790972734.374870:0:23867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad42400, rc 0) 00000100:00100000:2.0:1790972734.375017:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e07da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+24:18709:x1877970377665920:12345-192.168.203.39@tcp:101:dd.0 Request processed in 647us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972734.375025:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 44 00000100:00100000:1.0:1790972734.385533:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972734.386574:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377666176 00000100:00100000:2.0:1790972734.386587:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377666176 00000100:00100000:2.0:1790972734.386649:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 45 00000100:00100000:2.0:1790972734.386689:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e07da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+24:18709:x1877970377666176:12345-192.168.203.39@tcp:36:dd.0 00010000:00010000:2.0:1790972734.386940:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ffc lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.386958:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ffc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.386970:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ffc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790972734.387016:0:22642:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1790972734.387038:0:22642:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004ea3647d reply state 0000000044d2d778 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ffc lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.387049:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ffc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.387073:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:2.0:1790972734.387076:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1790972734.387080:0:22642:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790972734.387171:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e07da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+27:18709:x1877970377666176:12345-192.168.203.39@tcp:36:dd.0 Request processed in 513us (1649us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1790972734.387179:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 45 00000020:00080000:2.0:1790972734.387185:0:22642:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1790972734.390893:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972734.391122:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377666304 00000100:00100000:2.0:1790972734.391132:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377666304 00000100:00100000:2.0:1790972734.391233:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:2.0:1790972734.391259:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+27:18709:x1877970377666304:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:2.0:1790972734.391294:0:23867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972734.391313:0:23867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42e00/0xd61f4faa13a12003 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e98 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.391396:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42e00/0xd61f4faa13a12003 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e98 expref: 28 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.391427:0:23867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42e00/0xd61f4faa13a12003 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e98 expref: 28 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.391461:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:2.0:1790972734.391477:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790972734.391482:0:23867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e3ad42e00, rc 0) 00000100:00100000:2.0:1790972734.391731:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+28:18709:x1877970377666304:12345-192.168.203.39@tcp:101:dd.0 Request processed in 474us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972734.391753:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 46 00000100:00100000:1.0:1790972734.404573:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972734.404699:0:22629:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377666560 00000100:00100000:0.0:1790972734.404710:0:22629:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377666560 00000100:00100000:0.0:1790972734.404777:0:22629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:0.0:1790972734.404787:0:22629:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e07da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+28:18709:x1877970377666560:12345-192.168.203.39@tcp:103:dd.0 00010000:00010000:0.0:1790972734.404801:0:22629:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972734.404835:0:22629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42e00/0xd61f4faa13a12003 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e98 expref: 28 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972734.404856:0:22629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:0.0:1790972734.404861:0:22629:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790972734.404930:0:22629:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e07da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+27:18709:x1877970377666560:12345-192.168.203.39@tcp:103:dd.0 Request processed in 144us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972734.404938:0:22629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 2 00000100:00100000:1.0:1790972734.407361:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972734.407525:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377666688 00000100:00100000:2.0:1790972734.407535:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377666688 00000100:00100000:2.0:1790972734.407589:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:2.0:1790972734.407598:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e07da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+27:18709:x1877970377666688:12345-192.168.203.39@tcp:58:dd.0 00010000:00010000:2.0:1790972734.407731:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2e00/0xd61f4faa13a1200a lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.407749:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2e00/0xd61f4faa13a1200a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972734.407760:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2e00/0xd61f4faa13a1200a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790972734.409093:0:22642:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790972734.409126:0:22642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1790972734.409484:0:22642:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1790972734.409775:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e07da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+27:18709:x1877970377666688:12345-192.168.203.39@tcp:58:dd.0 Request processed in 2174us (2419us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972734.409786:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 47 00000100:00100000:2.0:1790972734.412627:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972734.412815:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377666816 00000100:00100000:1.0:1790972734.412825:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377666816 00000100:00100000:1.0:1790972734.413043:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:1.0:1790972734.413055:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+27:18709:x1877970377666816:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1790972734.413091:0:23867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972734.413113:0:23867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a12011 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1e9f expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.413172:0:23867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2e00/0xd61f4faa13a1200a lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.413184:0:23867:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a12011 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e9f expref: 28 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.413203:0:23867:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2e00/0xd61f4faa13a1200a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.413216:0:23867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a12011 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e9f expref: 28 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.413228:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:1.0:1790972734.413232:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790972734.413235:0:23867:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a12011 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e9f expref: 28 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972734.413242:0:23867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1eb200, rc 0) 00000100:00100000:1.0:1790972734.413299:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+28:18709:x1877970377666816:12345-192.168.203.39@tcp:101:dd.0 Request processed in 246us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972734.413306:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 48 00000100:00100000:0.0:1790972734.709406:0:3640:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07d7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397685760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1790972734.709799:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397686144:0@lo:400:kworker.0 00000100:00100000:1.0:1790972734.709843:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972734.709890:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397686656:0@lo:400:kworker.0 00000100:00100000:1.0:1790972734.709922:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972734.709939:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e16374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877970397687168:0@lo:400:kworker.0 00000100:00100000:1.0:1790972734.709966:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972734.709991:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1790972734.709996:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397686016:0@lo:400:kworker.0 00000100:00100000:1.0:1790972734.710017:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972734.710033:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397686528:0@lo:400:kworker.0 00000100:00100000:1.0:1790972734.710050:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972734.710066:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877970397687040:0@lo:400:kworker.0 00000100:00100000:1.0:1790972734.710089:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972734.710116:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397686016 00000100:00100000:1.0:1790972734.710124:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397686016 00000100:00100000:1.0:1790972734.710310:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397686528 00000100:00100000:1.0:1790972734.710314:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397686528 00000100:00100000:1.0:1790972734.710329:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790972734.710337:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397686016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972734.710391:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397686016:12345-0@lo:400:kworker.0 Request processed in 53us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972734.710398:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1790972734.710416:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790972734.710422:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397686528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972734.710450:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397686528:12345-0@lo:400:kworker.0 Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972734.710457:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790972734.710490:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397686016:0@lo:400:kworker.0 00000100:00100000:1.0:1790972734.710524:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397686528:0@lo:400:kworker.0 00000100:00100000:1.0:1790972734.710550:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397687168 00000100:00100000:1.0:1790972734.710553:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397687168 00000100:00100000:1.0:1790972734.710585:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397687040 00000100:00100000:1.0:1790972734.710588:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397687040 00000100:00100000:1.0:1790972734.710607:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790972734.710613:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877970397687168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972734.710683:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3639:x1877970397687168:12345-0@lo:400:kworker.0 Request processed in 49us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972734.710690:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790972734.710703:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790972734.710709:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877970397687040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790972734.710737:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3639:x1877970397687040:12345-0@lo:400:kworker.0 Request processed in 28us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972734.710742:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790972734.710767:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3639:1877970397687040:0@lo:400:kworker.0 00010000:00080000:1.0:1790972734.710779:0:3639:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e16374380 x1877970397687168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790972734.710789:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e16374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3639:1877970397687168:0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.710970:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397685888:0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711006:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972734.711035:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877970397686400:0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711057:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972734.711073:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877970397686912:0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711094:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972734.711104:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e16375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877970397687424:0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711122:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972734.711158:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1790972734.711164:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397686272:0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711187:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972734.711206:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e07da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397686784:0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711224:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790972734.711239:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e16374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1877970397687296:0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711257:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790972734.711282:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790972734.711286:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790972734.711292:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790972734.711299:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397687552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790972734.711326:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397686400 00000100:00100000:2.0:1790972734.711330:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397686400 00000100:00100000:2.0:1790972734.711353:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397686912 00000100:00100000:2.0:1790972734.711355:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397686912 00000100:00100000:2.0:1790972734.711366:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397687424 00000100:00100000:2.0:1790972734.711368:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397687424 00000100:00100000:2.0:1790972734.711384:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397687296 00000100:00100000:2.0:1790972734.711387:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397687296 00000100:00100000:2.0:1790972734.711400:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790972734.711405:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877970397686400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711443:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3641:x1877970397686400:12345-0@lo:400:kworker.0 Request processed in 37us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972734.711448:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790972734.711462:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790972734.711467:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877970397686912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711492:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3641:x1877970397686912:12345-0@lo:400:kworker.0 Request processed in 25us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972734.711507:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790972734.711518:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790972734.711524:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877970397687424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711549:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3641:x1877970397687424:12345-0@lo:400:kworker.0 Request processed in 26us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972734.711554:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790972734.711564:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790972734.711569:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877970397687296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711594:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3641:x1877970397687296:12345-0@lo:400:kworker.0 Request processed in 25us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972734.711599:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1790972734.711611:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790972734.711613:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1790972734.711632:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e16374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3641:1877970397687296:0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711642:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3641:1877970397686400:0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711650:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3641:1877970397686912:0@lo:400:kworker.0 00010000:00080000:2.0:1790972734.711659:0:3641:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff888e16375500 x1877970397687424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790972750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790972734.711708:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e16375500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3641:1877970397687424:0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.711778:0:24693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397686144 00000100:00100000:2.0:1790972734.711782:0:24693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397686144 00000100:00100000:2.0:1790972734.711802:0:24693:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397686656 00000100:00100000:2.0:1790972734.711804:0:24693:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397686656 00000100:00100000:0.0:1790972734.712045:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972734.712101:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397686272 00000100:00100000:0.0:1790972734.712105:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397686272 00000100:00100000:0.0:1790972734.712127:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397686784 00000100:00100000:0.0:1790972734.712129:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397686784 00000100:00100000:0.0:1790972734.712154:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790972734.712160:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397686144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972734.712200:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397686144:12345-0@lo:400:kworker.0 Request processed in 40us (2356us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972734.712206:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790972734.712217:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790972734.712224:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397686272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972734.712257:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397686272:12345-0@lo:400:kworker.0 Request processed in 34us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972734.712273:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790972734.712286:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790972734.712292:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397686784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972734.712321:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3641:x1877970397686784:12345-0@lo:400:kworker.0 Request processed in 31us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972734.712327:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790972734.712361:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397686272:0@lo:400:kworker.0 00000100:00100000:0.0:1790972734.712370:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3641:1877970397686784:0@lo:400:kworker.0 00000100:00100000:0.0:1790972734.712392:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972734.712418:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397686144:0@lo:400:kworker.0 00000100:00100000:0.0:1790972734.712436:0:24151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397685760 00000100:00100000:0.0:1790972734.712439:0:24151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397685760 00000100:00100000:0.0:1790972734.712456:0:24151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397687552 00000100:00100000:0.0:1790972734.712458:0:24151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397687552 00000100:00100000:0.0:1790972734.712469:0:24151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790972734.712475:0:24151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397685760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1790972734.712524:0:24151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790972734.712561:0:24151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3640:x1877970397685760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (3081us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972734.712567:0:24151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790972734.712579:0:24151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790972734.712585:0:24151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397687552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790972734.712593:0:24151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1790972734.712620:0:24151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3639:x1877970397687552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972734.712631:0:24151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790972734.712681:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08951880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3639:1877970397687552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790972734.712708:0:3640:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07d7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3640:1877970397685760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1790972734.712744:0:22637:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397685888 00000100:00100000:0.0:1790972734.712747:0:22637:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397685888 00000100:00100000:0.0:1790972734.712773:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790972734.712779:0:22637:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:3641:x1877970397685888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790972734.712815:0:22637:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a747c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1ec21a69-0990-44c5-a524-ae99bc1e2f2c+24:3641:x1877970397685888:12345-0@lo:400:kworker.0 Request processed in 36us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972734.713063:0:24693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790972734.713079:0:24693:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397686656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790972734.713120:0:24693:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397686656:12345-0@lo:400:kworker.0 Request processed in 43us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972734.713125:0:24693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790972734.713402:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1ec21a69-0990-44c5-a524-ae99bc1e2f2c:3641:1877970397685888:0@lo:400:kworker.0 00000100:00080000:1.0:1790972734.713439:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790972734.713444:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790972734.713470:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e07da0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397686656:0@lo:400:kworker.0 00000100:00100000:0.0:1790972734.714689:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1790972734.722036:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397687680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1790972734.722128:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972734.724343:0:24151:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397687680 00000100:00100000:0.0:1790972734.724364:0:24151:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397687680 00000100:00100000:0.0:1790972734.724449:0:24151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790972734.724460:0:24151:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397687680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1790972734.724489:0:24151:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1790972734.724929:0:24151:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397687680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 470us (2801us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972734.724937:0:24151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790972734.725093:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397687680:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1790972735.029001:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790972735.348872:0:22676:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1790972735.348881:0:22676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790972735.348912:0:22676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1790972735.348921:0:22676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1790972735.349065:0:22676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e3adf8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22676:1877970397687808:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790972735.349157:0:22676:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e10d75900 going to sleep for 11 seconds 00000100:00100000:1.0:1790972735.357784:0:22676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e3adf8000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22676:1877970397687808:192.168.203.39@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790972735.359995:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972735.361972:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377666944 00000100:00100000:0.0:1790972735.361987:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377666944 00000100:00100000:0.0:1790972735.362073:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00100000:0.0:1790972735.362086:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+28:18710:x1877970377666944:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790972735.362118:0:22642:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790972735.362268:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+28:18710:x1877970377666944:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 184us (2282us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972735.362287:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 49 00000100:00080000:1.0:1790972735.362703:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790972735.367388:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972735.367470:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377667072 00000100:00100000:2.0:1790972735.367481:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377667072 00000100:00100000:2.0:1790972735.367553:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:2.0:1790972735.367563:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+28:18710:x1877970377667072:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1790972735.367634:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2a00/0xd61f4faa13a12018 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367652:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2a00/0xd61f4faa13a12018 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367686:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2a00/0xd61f4faa13a12018 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367722:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3e00/0xd61f4faa13a1201f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367730:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3e00/0xd61f4faa13a1201f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367755:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3e00/0xd61f4faa13a1201f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367780:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3200/0xd61f4faa13a12026 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367789:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3200/0xd61f4faa13a12026 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367797:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3200/0xd61f4faa13a12026 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790972735.367853:0:23867:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1790972735.367858:0:23867:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1790972735.367873:0:23867:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3200/0xd61f4faa13a12026 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367885:0:23867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2a00/0xd61f4faa13a12018 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367892:0:23867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2a00/0xd61f4faa13a12018 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367909:0:23867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2a00/0xd61f4faa13a12018 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367916:0:23867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e41fc2a00 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:2.0:1790972735.367921:0:23867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2a00/0xd61f4faa13a12018 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367930:0:23867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2a00/0xd61f4faa13a12018 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367949:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff888e10c71600) 00010000:00010000:2.0:1790972735.367952:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790972735.367957:0:23867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2a00/0xd61f4faa13a12018 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367962:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2a00/0xd61f4faa13a12018 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367975:0:23867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3e00/0xd61f4faa13a1201f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367993:0:23867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3e00/0xd61f4faa13a1201f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.367998:0:23867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3e00/0xd61f4faa13a1201f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.368003:0:23867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e41fc3e00 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:2.0:1790972735.368006:0:23867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3e00/0xd61f4faa13a1201f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.368012:0:23867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3e00/0xd61f4faa13a1201f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.368023:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff888d06e3bc00) 00010000:00010000:2.0:1790972735.368025:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790972735.368028:0:23867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3e00/0xd61f4faa13a1201f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.368033:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3e00/0xd61f4faa13a1201f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.368059:0:23867:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3200/0xd61f4faa13a12026 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.368065:0:23867:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3200/0xd61f4faa13a12026 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.368070:0:23867:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3200/0xd61f4faa13a12026 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.368075:0:23867:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e41fc3200 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:2.0:1790972735.368078:0:23867:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3200/0xd61f4faa13a12026 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.368083:0:23867:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3200/0xd61f4faa13a12026 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.368090:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:2.0:1790972735.368092:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790972735.368095:0:23867:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3200/0xd61f4faa13a12026 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.368101:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3200/0xd61f4faa13a12026 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972735.384534:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+28:18710:x1877970377667072:12345-192.168.203.39@tcp:34:lhsmtool_posix.0 Request processed in 16960us (17143us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972735.384549:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 50 00000100:00100000:3.0:1790972735.394145:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972735.397272:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377667328 00000100:00100000:2.0:1790972735.397287:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377667328 00000100:00100000:2.0:1790972735.397367:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:2.0:1790972735.397394:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+28:18710:x1877970377667328:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790972735.397415:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972735.397435:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3c00/0xd61f4faa13a1202d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1ea6 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.397534:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12034 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.397549:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12034 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.397560:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12034 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790972735.397570:0:22642:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790972735.397653:0:22642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12034 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.397679:0:22642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12034 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.397687:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12034 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.397692:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e41fc2600 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:2.0:1790972735.397696:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12034 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.397704:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12034 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.397715:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:2.0:1790972735.397727:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790972735.397733:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12034 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.397739:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12034 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.397781:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3c00/0xd61f4faa13a1202d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ea6 expref: 30 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.397791:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff888e10c71600) 00010000:00010000:2.0:1790972735.397793:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790972735.397796:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3c00/0xd61f4faa13a1202d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ea6 expref: 30 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.397807:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e41fc3c00, rc 0) 00000100:00100000:2.0:1790972735.397870:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+29:18710:x1877970377667328:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 478us (3734us total) trans 12884901907 rc 301/301 00000100:00100000:2.0:1790972735.397877:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 51 00000100:00100000:1.0:1790972735.407910:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972735.408209:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377667456 00000100:00100000:0.0:1790972735.408220:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377667456 00000100:00100000:0.0:1790972735.408281:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:0.0:1790972735.408291:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+29:18710:x1877970377667456:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790972735.408326:0:22644:0:(mdt_handler.c:7978:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790972735.408451:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+29:18710:x1877970377667456:12345-192.168.203.39@tcp:53:lhsmtool_posix.0 Request processed in 161us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972735.408459:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 52 00000100:00100000:0.0:1790972735.418402:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972735.418501:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377667712 00000100:00100000:2.0:1790972735.418511:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377667712 00000100:00100000:2.0:1790972735.418570:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:2.0:1790972735.418580:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+29:18710:x1877970377667712:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790972735.418600:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790972735.418621:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3c00/0xd61f4faa13a12042 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1ead expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790972735.419045:0:22642:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:2.0:1790972735.419064:0:22642:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:2.0:1790972735.419085:0:22642:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:2.0:1790972735.419225:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12049 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.419240:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12049 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.419251:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12049 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.419304:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc3c00/0xd61f4faa13a12042 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ead expref: 32 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.419324:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12049 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ead expref: 31 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.419333:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff888d06e3bc00) 00010000:00010000:2.0:1790972735.419335:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790972735.419339:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e41fc2600, rc 0) 00000100:00100000:2.0:1790972735.419410:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+31:18710:x1877970377667712:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 831us (1015us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1790972735.419418:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:3.0:1790972735.425932:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972735.427234:0:22644:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377667968 00000100:00100000:0.0:1790972735.427247:0:22644:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377667968 00000100:00100000:0.0:1790972735.427318:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:0.0:1790972735.427329:0:22644:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+31:18710:x1877970377667968:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790972735.427391:0:22644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790972735.427418:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2600/0xd61f4faa13a12049 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ead expref: 31 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.427438:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff888d06e3bc00) 00010000:00010000:0.0:1790972735.427448:0:22644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790972735.427471:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a12057 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.427616:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a12057 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.427629:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a12057 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.427659:0:22644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a1205e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3e2ef7c2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.428488:0:22644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a1205e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3e2ef7c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.428498:0:22644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a1205e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3e2ef7c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429265:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a12057 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429275:0:22644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a12057 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429282:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a12057 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429288:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bddc00 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972735.429292:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a12057 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429300:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a12057 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429312:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff888e08b6f500) 00010000:00010000:0.0:1790972735.429316:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972735.429320:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a12057 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429326:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a12057 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429358:0:22644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a1205e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3e2ef7c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429364:0:22644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a1205e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3e2ef7c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429369:0:22644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a1205e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3e2ef7c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429374:0:22644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdd800 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972735.429377:0:22644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a1205e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3e2ef7c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429382:0:22644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a1205e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x3e2ef7c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429390:0:22644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x3e2ef7c2 (ffff888e10c71b00) 00010000:00010000:0.0:1790972735.429393:0:22644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972735.429395:0:22644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a1205e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3e2ef7c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.429400:0:22644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a1205e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x3e2ef7c2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972735.429521:0:22644:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+30:18710:x1877970377667968:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 2191us (3594us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790972735.429531:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:1.0:1790972735.436739:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972735.436813:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377668096 00000100:00100000:0.0:1790972735.436823:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377668096 00000100:00100000:0.0:1790972735.436872:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:0.0:1790972735.436895:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+30:18710:x1877970377668096:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790972735.436926:0:22642:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790972735.436950:0:22642:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a12065 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1eb4 expref: -99 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.436986:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc400/0xd61f4faa13a1206c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.437001:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc400/0xd61f4faa13a1206c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.437012:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc400/0xd61f4faa13a1206c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.437115:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a12065 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1eb4 expref: 32 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.437131:0:22642:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdc400/0xd61f4faa13a1206c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1eb4 expref: 31 pid: 22642 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.437152:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff888e10c71d00) 00010000:00010000:0.0:1790972735.437155:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790972735.437158:0:22642:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888d06bdc400, rc 0) 00000100:00100000:0.0:1790972735.437221:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+31:18710:x1877970377668096:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 328us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1790972735.437227:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:2.0:1790972735.446055:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.446149:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377668352 00000100:00100000:1.0:1790972735.446159:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377668352 00000100:00100000:1.0:1790972735.446222:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:1.0:1790972735.446233:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3adf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+31:18710:x1877970377668352:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790972735.446315:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12073 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.446332:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12073 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.446344:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12073 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790972735.446502:0:23867:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1790972735.446511:0:23867:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 673473848652ns, next at 674473846369ns, rc = 0 00000004:00010000:1.0:1790972735.446558:0:23867:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000153be4fa reply state 000000001e328d6d transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12073 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.446571:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12073 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.446578:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff888e10c71d00) 00010000:00010000:1.0:1790972735.446594:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1790972735.446599:0:23867:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790972735.446722:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3adf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+33:18710:x1877970377668352:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 490us (674us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1790972735.446729:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 56 00000100:00100000:3.0:1790972735.458228:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.458407:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377668480 00000100:00100000:1.0:1790972735.458417:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377668480 00000100:00100000:1.0:1790972735.458478:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:1.0:1790972735.458488:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+33:18710:x1877970377668480:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790972735.458513:0:22643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972735.458534:0:22643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eac00/0xd61f4faa13a1207a lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1ebb expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.458595:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eac00/0xd61f4faa13a1207a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ebb expref: 34 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.458611:0:22643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eac00/0xd61f4faa13a1207a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ebb expref: 34 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.458630:0:22643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff888e10c71d00) 00010000:00010000:1.0:1790972735.458634:0:22643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790972735.458638:0:22643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1eac00, rc 0) 00000100:00100000:1.0:1790972735.458735:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+34:18710:x1877970377668480:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 248us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.458743:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 57 00000100:00100000:3.0:1790972735.478445:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972735.481149:0:24147:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377668608 00000100:00100000:0.0:1790972735.481163:0:24147:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377668608 00000100:00100000:1.0:1790972735.481372:0:24147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:1.0:1790972735.481385:0:24147:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2399:x1877970377668608:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1790972735.481716:0:24147:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2399:x1877970377668608:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 333us (3277us total) trans 12884901891 rc 0/0 00000100:00100000:1.0:1790972735.481724:0:24147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00080000:2.0:1790972735.481779:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790972735.490184:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972735.490308:0:22645:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377668864 00000100:00100000:0.0:1790972735.490333:0:22645:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377668864 00000100:00100000:0.0:1790972735.490393:0:22645:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:0.0:1790972735.490403:0:22645:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e029af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+34:18710:x1877970377668864:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790972735.491166:0:22645:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e029af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+35:18710:x1877970377668864:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 762us (1376us total) trans 12884901910 rc 0/0 00000100:00100000:0.0:1790972735.491176:0:22645:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 9 00000100:00100000:3.0:1790972735.493142:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.493267:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377669120 00000100:00100000:1.0:1790972735.493277:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377669120 00000100:00100000:1.0:1790972735.493338:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:1.0:1790972735.493348:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+35:18710:x1877970377669120:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790972735.493456:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+35:18710:x1877970377669120:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 110us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.493464:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 58 00000100:00100000:3.0:1790972735.497599:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.497744:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377669248 00000100:00100000:1.0:1790972735.497753:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377669248 00000100:00100000:1.0:1790972735.497808:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:1.0:1790972735.497819:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+35:18710:x1877970377669248:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790972735.497838:0:22643:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972735.497857:0:22643:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a12081 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1ec2 expref: -99 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.497943:0:22643:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea400/0xd61f4faa13a12088 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.497958:0:22643:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea400/0xd61f4faa13a12088 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.497970:0:22643:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea400/0xd61f4faa13a12088 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790972735.498041:0:22643:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1790972735.498060:0:22643:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea400/0xd61f4faa13a12088 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.498086:0:22643:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb800/0xd61f4faa13a12081 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ec2 expref: 37 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.498103:0:22643:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea400/0xd61f4faa13a12088 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ec2 expref: 36 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.498112:0:22643:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff888e10c71d00) 00010000:00010000:1.0:1790972735.498114:0:22643:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790972735.498118:0:22643:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1ea400, rc 0) 00000100:00100000:1.0:1790972735.498180:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+36:18710:x1877970377669248:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 363us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.498188:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 59 00000100:00100000:2.0:1790972735.508869:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.508984:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377669376 00000100:00100000:1.0:1790972735.508995:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377669376 00000100:00100000:1.0:1790972735.509060:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:1.0:1790972735.509071:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e029aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2399:x1877970377669376:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790972735.509089:0:24149:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972735.509109:0:24149:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a1208f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1ec9 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790972735.509134:0:24149:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6ac01340, blocks: 0x0 00010000:00010000:1.0:1790972735.509153:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=673s v=(0 0) 00010000:00010000:1.0:1790972735.509170:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972735.509179:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a1208f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ec9 expref: 7 pid: 24149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.509199:0:24149:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a1208f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ec9 expref: 7 pid: 24149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.509213:0:24149:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1eb800, rc 0) 00000100:00100000:1.0:1790972735.509278:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e029aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+7:2399:x1877970377669376:12345-192.168.203.39@tcp:101:lhsmtool_posix.0 Request processed in 208us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.509286:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 22 00000100:00100000:2.0:1790972735.513203:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.513331:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377669632 00000100:00100000:1.0:1790972735.513341:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377669632 00000100:00100000:1.0:1790972735.513411:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:1.0:1790972735.513421:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e029aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+36:18710:x1877970377669632:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790972735.513536:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e029aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+36:18710:x1877970377669632:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 117us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.513544:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 60 00000100:00100000:3.0:1790972735.520498:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.520589:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377669760 00000100:00100000:1.0:1790972735.520600:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377669760 00000100:00100000:1.0:1790972735.520698:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:1.0:1790972735.520709:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d088c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+36:18710:x1877970377669760:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790972735.522884:0:22622:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:2.0:1790972735.522919:0:22622:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1790972735.522975:0:22622:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:0.0:1790972735.523156:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea800/0xd61f4faa13a11ec8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523169:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea800/0xd61f4faa13a11ec8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523177:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea800/0xd61f4faa13a11ec8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523184:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1ea800 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972735.523188:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea800/0xd61f4faa13a11ec8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523196:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea800/0xd61f4faa13a11ec8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523212:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff888e08b6fb00) 00010000:00010000:0.0:1790972735.523215:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972735.523220:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea800/0xd61f4faa13a11ec8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523225:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea800/0xd61f4faa13a11ec8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523258:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a11ecf lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523265:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a11ecf lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523270:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a11ecf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523275:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eba00 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972735.523278:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a11ecf lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523284:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a11ecf lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523291:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff888e08b6f500) 00010000:00010000:0.0:1790972735.523294:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972735.523296:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a11ecf lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523302:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a11ecf lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523313:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f77 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523319:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f77 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523324:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f77 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523334:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad43000 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972735.523337:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f77 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523342:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f77 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523350:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff888d06e3b000) 00010000:00010000:0.0:1790972735.523352:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972735.523355:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f77 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523360:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad43000/0xd61f4faa13a11f77 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22643 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523376:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ffc lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523382:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ffc lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523386:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ffc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523391:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e3ad42a00 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972735.523393:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ffc lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523398:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ffc lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523415:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:0.0:1790972735.523418:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972735.523421:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ffc lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523426:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42a00/0xd61f4faa13a11ffc lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523437:0:3625:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12073 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523444:0:3625:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12073 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523450:0:3625:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12073 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523455:0:3625:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eaa00 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972735.523458:0:3625:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12073 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523464:0:3625:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12073 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523471:0:3625:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff888e10c71d00) 00010000:00010000:0.0:1790972735.523474:0:3625:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790972735.523477:0:3625:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12073 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.523482:0:3625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12073 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.523717:0:3624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11f1c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.523725:0:3624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11f1c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.523736:0:3624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11f1c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.523740:0:3624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb6000 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:1.0:1790972735.523743:0:3624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11f1c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.523749:0:3624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11f1c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.523756:0:3624:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff888e08b6f500) 00010000:00010000:1.0:1790972735.523759:0:3624:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1790972735.523761:0:3624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11f1c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.523766:0:3624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb6000/0xd61f4faa13a11f1c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972735.523892:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d088c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+15:18710:x1877970377669760:12345-192.168.203.39@tcp:44:lhsmtool_posix.0 Request processed in 3181us (3407us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.523912:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 61 00000100:00100000:2.0:1790972735.524182:0:3641:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790972735.524199:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d088cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397687936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790972735.524250:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790972735.524843:0:24150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397687936 00000100:00100000:1.0:1790972735.524852:0:24150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397687936 00000100:00100000:1.0:1790972735.524894:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790972735.524912:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e029aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397687936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1790972735.525033:0:24150:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790972735.525037:0:24150:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790972735.525039:0:24150:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790972735.525041:0:24150:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1790972736 -> 1790972736 00002000:00010000:1.0:1790972735.525053:0:24150:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1790972735.525107:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e029aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3641:x1877970397687936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 205us (856us total) trans 12884901892 rc 0/0 00000100:00100000:1.0:1790972735.525113:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000004:00080000:2.0:1790972735.525265:0:3641:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff888d088cbb80/2, rc 0, transno 12884901892 00000100:00100000:2.0:1790972735.525272:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d088cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397687936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1790972735.530592:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.530756:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377669888 00000100:00100000:1.0:1790972735.530765:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377669888 00000100:00100000:1.0:1790972735.530829:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:1.0:1790972735.530838:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e029af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+7:2399:x1877970377669888:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1790972735.530951:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e029af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+7:2399:x1877970377669888:12345-192.168.203.39@tcp:16:lhsmtool_posix.0 Request processed in 113us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.530959:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 24 00000100:00100000:3.0:1790972735.539656:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.539788:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377670144 00000100:00100000:1.0:1790972735.539799:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377670144 00000100:00100000:1.0:1790972735.539861:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:1.0:1790972735.539871:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+15:18710:x1877970377670144:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790972735.539963:0:23867:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790972735.540001:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea400/0xd61f4faa13a12088 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ec2 expref: 15 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.540022:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff888e10c71d00) 00010000:00010000:1.0:1790972735.540026:0:23867:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790972735.540055:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12096 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.540068:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12096 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.540078:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12096 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790972735.540205:0:23867:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f3aba37b reply state 00000000a5aa6323 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12096 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.540218:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eaa00/0xd61f4faa13a12096 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.540225:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff888e10c71d00) 00010000:00010000:1.0:1790972735.540228:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1790972735.540230:0:23867:0:(service.c:197:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790972735.540330:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+16:18710:x1877970377670144:12345-192.168.203.39@tcp:36:lhsmtool_posix.0 Request processed in 459us (682us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1790972735.540339:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 62 00000100:00100000:1.0:1790972735.542927:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972735.543235:0:24150:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377670272 00000100:00100000:0.0:1790972735.543244:0:24150:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377670272 00000100:00100000:0.0:1790972735.543300:0:24150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:0.0:1790972735.543310:0:24150:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+7:2398:x1877970377670272:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790972735.543459:0:24150:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1790972735.543462:0:24150:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1790972734 00002000:00010000:0.0:1790972735.543465:0:24150:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1790972734 00002000:00010000:0.0:1790972735.543467:0:24150:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1790972736 -> 1790972734 00002000:00010000:0.0:1790972735.543469:0:24150:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1790972735.543628:0:24150:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:528aeac5-b99c-4b0d-ae9b-e84937861361+8:2398:x1877970377670272:12345-192.168.203.39@tcp:2:lhsmtool_posix.0 Request processed in 318us (709us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1790972735.543635:0:24150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 25 00000100:00100000:2.0:1790972735.546225:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.546300:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377670400 00000100:00100000:1.0:1790972735.546311:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377670400 00000100:00100000:1.0:1790972735.546368:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:1.0:1790972735.546378:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e1d296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+8:2397:x1877970377670400:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790972735.546420:0:24149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a1209d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.546438:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972735.546444:0:24149:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972735.546449:0:24149:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a1209d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.546463:0:24149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a1209d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.546523:0:24149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a1209d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.546531:0:24149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a1209d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.546539:0:24149:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a1209d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.546547:0:24149:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e1d1eba00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:1.0:1790972735.546551:0:24149:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a1209d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.546559:0:24149:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a1209d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.546574:0:24149:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a1209d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.546581:0:24149:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022f19e65/0xd61f4faa13a1209d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24149 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972735.546657:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e1d296c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+8:2397:x1877970377670400:12345-192.168.203.39@tcp:1:lhsmtool_posix.0 Request processed in 280us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.546723:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 26 00000100:00100000:3.0:1790972735.550137:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972735.550286:0:22642:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377670656 00000100:00100000:0.0:1790972735.550297:0:22642:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377670656 00000100:00100000:0.0:1790972735.550351:0:22642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 63 00000100:00100000:0.0:1790972735.550361:0:22642:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+16:18710:x1877970377670656:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790972735.550449:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.550466:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ff5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e91 expref: 16 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.550475:0:22642:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.550523:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ff5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e91 expref: 16 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.550552:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ff5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e91 expref: 16 pid: 23867 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972735.550567:0:22642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22642:1877970397688064:192.168.203.39@tcp:104: 00000100:00100000:0.0:1790972735.550649:0:22642:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e1703df00 going to sleep for 11 seconds 00000100:00100000:3.0:1790972735.554001:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.554129:0:22628:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377670784 00000100:00100000:1.0:1790972735.554139:0:22628:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377670784 00010000:00010000:1.0:1790972735.554181:0:22628:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ff5 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e91 expref: 17 pid: 23867 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972735.554221:0:22628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 19 00000100:00100000:1.0:1790972735.554230:0:22628:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d08897b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+17:2398:x1877970377670784:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790972735.554242:0:22628:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790972735.554249:0:22628:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ff5 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e91 expref: 17 pid: 23867 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.554261:0:22628:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ff5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e91 expref: 17 pid: 23867 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.554283:0:22628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:1.0:1790972735.554289:0:22628:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a12011 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e9f expref: 17 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.554299:0:22628:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.554305:0:22628:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.554313:0:22628:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.554346:0:22628:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790972735.554408:0:22628:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08897b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+17:2398:x1877970377670784:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 179us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.554416:0:22628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 19 00010000:00010000:0.0:1790972735.554523:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e3ad42400/0xd61f4faa13a11ff5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e91 expref: 16 pid: 23867 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972735.554540:0:22642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22642:1877970397688064:192.168.203.39@tcp:104: 00010000:00010000:0.0:1790972735.554558:0:22642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.554566:0:22642:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.554571:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.554814:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.554828:0:22642:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eac00/0xd61f4faa13a1207a lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ebb expref: 16 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.554835:0:22642:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.554860:0:22642:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eac00/0xd61f4faa13a1207a lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ebb expref: 16 pid: 22643 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.554879:0:22642:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eac00/0xd61f4faa13a1207a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ebb expref: 16 pid: 22643 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972735.554891:0:22642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22642:1877970397688192:192.168.203.39@tcp:104: 00000100:00100000:0.0:1790972735.554951:0:22642:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e1703d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790972735.558038:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972735.558123:0:22627:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377670912 00000100:00100000:3.0:1790972735.558132:0:22627:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377670912 00010000:00010000:3.0:1790972735.558172:0:22627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eac00/0xd61f4faa13a1207a lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ebb expref: 17 pid: 22643 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790972735.558214:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 20 00000100:00100000:3.0:1790972735.558237:0:22627:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e029ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+17:2398:x1877970377670912:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790972735.558252:0:22627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790972735.558259:0:22627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eac00/0xd61f4faa13a1207a lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ebb expref: 17 pid: 22643 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972735.558272:0:22627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eac00/0xd61f4faa13a1207a lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ebb expref: 17 pid: 22643 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972735.558292:0:22627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff888e10c71d00) 00010000:00010000:3.0:1790972735.558297:0:22627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972735.558307:0:22627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972735.558315:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972735.558331:0:22627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790972735.558385:0:22627:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e029ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+17:2398:x1877970377670912:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 149us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972735.558392:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 20 00010000:00010000:0.0:1790972735.560068:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eac00/0xd61f4faa13a1207a lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ebb expref: 16 pid: 22643 timeout: 773 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972735.560092:0:22642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22642:1877970397688192:192.168.203.39@tcp:104: 00010000:00010000:0.0:1790972735.560114:0:22642:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.560124:0:22642:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.560130:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790972735.560237:0:22642:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:0.0:1790972735.560349:0:22642:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:0.0:1790972735.560644:0:22642:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:0.0:1790972735.560770:0:22642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22642:1877970397688320:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790972735.560835:0:22642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972735.560870:0:22642:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e3955d240 going to sleep for 11 seconds 00000100:00100000:2.0:1790972735.561052:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397688320 00000100:00100000:2.0:1790972735.561059:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397688320 00000100:00100000:2.0:1790972735.561111:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790972735.561122:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22642:x1877970397688320:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790972735.561210:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22642:x1877970397688320:12345-0@lo:1000:mdt00_000.0 Request processed in 91us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972735.561218:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790972735.561338:0:22642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22642:1877970397688320:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1790972735.561477:0:22642:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:0.0:1790972735.561594:0:22642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22642:1877970397688448:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1790972735.561638:0:22642:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790972735.561688:0:22642:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e1703d900 going to sleep for 11 seconds 00000100:00100000:2.0:1790972735.561822:0:23382:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397688448 00000100:00100000:2.0:1790972735.561827:0:23382:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397688448 00000100:00100000:2.0:1790972735.561860:0:23382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790972735.561868:0:23382:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22642:x1877970397688448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1790972735.561991:0:23382:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22642:x1877970397688448:12345-0@lo:1000:mdt00_000.0 Request processed in 124us (353us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1790972735.561998:0:23382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790972735.562139:0:22642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07d7ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22642:1877970397688448:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1790972735.562173:0:22642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562184:0:22642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562192:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562198:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdd800 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972735.562202:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562210:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562225:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff888e10c71d00) 00010000:00010000:0.0:1790972735.562229:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790972735.562233:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562238:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdd800/0xd61f4faa13a120ab lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562265:0:22642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2e00/0xd61f4faa13a1200a lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562271:0:22642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2e00/0xd61f4faa13a1200a lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562283:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2e00/0xd61f4faa13a1200a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562288:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e41fc2e00 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972735.562291:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2e00/0xd61f4faa13a1200a lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562297:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2e00/0xd61f4faa13a1200a lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562305:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:0.0:1790972735.562308:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790972735.562314:0:22642:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a12011 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e9f expref: 19 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562325:0:22642:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a12011 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e9f expref: 19 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562334:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a12011 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e9f expref: 19 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.562380:0:22642:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eb200/0xd61f4faa13a12011 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1e9f expref: 19 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972735.562392:0:22642:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d07d7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22642:1877970397688576:192.168.203.39@tcp:105: 00000100:00100000:0.0:1790972735.562455:0:22642:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e1703d900 going to sleep for 11 seconds 00000100:00100000:0.0:1790972735.565179:0:22642:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d07d7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22642:1877970397688576:192.168.203.39@tcp:105: 00010000:00010000:0.0:1790972735.565233:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2e00/0xd61f4faa13a1200a lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565243:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e41fc2e00/0xd61f4faa13a1200a lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565280:0:22642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a120b2 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565295:0:22642:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a120b2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565308:0:22642:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a120b2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565321:0:22642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a120b2 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565328:0:22642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a120b2 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565334:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a120b2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565339:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bddc00 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972735.565343:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a120b2 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565349:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a120b2 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565360:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:0.0:1790972735.565372:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790972735.565376:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a120b2 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565382:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bddc00/0xd61f4faa13a120b2 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565392:0:22642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565398:0:22642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565404:0:22642:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565408:0:22642:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d06bdcc00 already unused, calling callback (ffffffffc19b84f0) 00010000:00010000:0.0:1790972735.565411:0:22642:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565416:0:22642:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565424:0:22642:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:0.0:1790972735.565426:0:22642:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790972735.565428:0:22642:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.565433:0:22642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d06bdcc00/0xd61f4faa13a120a4 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22642 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972735.565741:0:22642:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d08894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:528aeac5-b99c-4b0d-ae9b-e84937861361+19:18710:x1877970377670656:12345-192.168.203.39@tcp:57:lhsmtool_posix.0 Request processed in 15379us (15610us total) trans 12884901916 rc 0/0 00000100:00100000:0.0:1790972735.565760:0:22642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 63 00000020:00080000:0.0:1790972735.565766:0:22642:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1790972735.567651:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972735.567976:0:22646:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377671040 00000100:00100000:3.0:1790972735.567987:0:22646:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377671040 00000100:00100000:3.0:1790972735.568047:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:3.0:1790972735.568057:0:22646:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e05012850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+19:18709:x1877970377671040:12345-192.168.203.39@tcp:49:dd.0 00000100:00100000:3.0:1790972735.568189:0:22646:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e05012850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+19:18709:x1877970377671040:12345-192.168.203.39@tcp:49:dd.0 Request processed in 134us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972735.568212:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 10 00000100:00100000:2.0:1790972735.569138:0:3633:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:3.0:1790972735.569337:0:22646:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377671296 00000100:00100000:3.0:1790972735.569344:0:22646:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377671296 00000100:00100000:3.0:1790972735.569383:0:22646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 11 00000100:00100000:3.0:1790972735.569391:0:22646:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e029ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+19:18710:x1877970377671296:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790972735.569636:0:22646:0:(mdd_object.c:4180:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790972735.569705:0:22646:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:3.0:1790972735.569741:0:22646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a120b9 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972735.569758:0:22646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a120b9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972735.569769:0:22646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a120b9 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972735.569778:0:22646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a120b9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972735.569785:0:22646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a120b9 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972735.569792:0:22646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a120b9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790972735.569804:0:22646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790972735.569998:0:22631:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790972735.570016:0:22631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a120b9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.570023:0:22631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888d07bb7e00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972735.570027:0:22631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a120b9 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.570035:0:22631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a120b9 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.570047:0:22631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff888e10c71d00) 00010000:00010000:2.0:1790972735.570050:0:22631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790972735.570054:0:22631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a120b9 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.570059:0:22631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888d07bb7e00/0xd61f4faa13a120b9 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22646 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.570070:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972735.570072:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790972735.570073:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790972735.570217:0:22646:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e029ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+21:18710:x1877970377671296:12345-192.168.203.39@tcp:35:lhsmtool_posix.0 Request processed in 824us (1082us total) trans 12884901918 rc 0/0 00000100:00100000:3.0:1790972735.570225:0:22646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 11 00000020:00080000:3.0:1790972735.570236:0:22646:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1790972735.570538:0:22676:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1790972735.570543:0:22676:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790972735.570563:0:22676:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1790972735.570572:0:22676:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1790972735.575245:0:3631:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.576707:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377671424 00000100:00100000:1.0:1790972735.576719:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377671424 00000100:00100000:1.0:1790972735.576780:0:23867:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:1.0:1790972735.576790:0:23867:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e029ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+21:18709:x1877970377671424:12345-192.168.203.39@tcp:101:dd.0 00010000:00010000:1.0:1790972735.577049:0:23867:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790972735.577072:0:23867:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a120c0 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x197238ab90fb1ed0 expref: -99 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.577110:0:23867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea400/0xd61f4faa13a120c7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.577125:0:23867:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea400/0xd61f4faa13a120c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.577137:0:23867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea400/0xd61f4faa13a120c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23867 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.577263:0:23867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1eba00/0xd61f4faa13a120c0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ed0 expref: 23 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.577294:0:23867:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff888e1d1ea400/0xd61f4faa13a120c7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ed0 expref: 22 pid: 23867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.577302:0:23867:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff888d06e3b400) 00010000:00010000:1.0:1790972735.577305:0:23867:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790972735.577309:0:23867:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff888e1d1ea400, rc 0) 00000100:00100000:1.0:1790972735.577547:0:23867:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e029ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+22:18709:x1877970377671424:12345-192.168.203.39@tcp:101:dd.0 Request processed in 695us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.577558:0:23867:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 64 00000100:00100000:0.0:1790972735.614580:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:0.0:1790972735.614620:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:2.0:1790972735.614726:0:24154:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377671680 00000100:00100000:2.0:1790972735.614738:0:24154:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377671680 00000100:00100000:2.0:1790972735.614800:0:24154:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377671552 00000100:00100000:2.0:1790972735.614804:0:24154:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377671552 00000100:00100000:2.0:1790972735.614834:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:2.0:1790972735.614843:0:24154:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+9:2398:x1877970377671680:12345-192.168.203.39@tcp:4:dd.0 00010000:00010000:2.0:1790972735.614875:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.614922:0:24154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a1208f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ec9 expref: 9 pid: 24149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.614931:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790972735.614935:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790972735.614940:0:24154:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.614972:0:24154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a1208f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ec9 expref: 9 pid: 24149 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.614986:0:24154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a1208f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ec9 expref: 9 pid: 24149 timeout: 773 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972735.615000:0:24154:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888e029ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:24154:1877970397688704:192.168.203.39@tcp:104: 00000100:00100000:2.0:1790972735.615071:0:24154:0:(client.c:2716:ptlrpc_set_wait()) set ffff888e10d75600 going to sleep for 11 seconds 00000100:00100000:0.0:1790972735.617239:0:24154:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888e029ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_001:lustre-OST0001_UUID:24154:1877970397688704:192.168.203.39@tcp:104: 00010000:00010000:0.0:1790972735.617270:0:24154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790972735.618377:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.618623:0:23795:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377671808 00000100:00100000:1.0:1790972735.618631:0:23795:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377671808 00010000:00010000:1.0:1790972735.618704:0:23795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a1208f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ec9 expref: 10 pid: 24149 timeout: 773 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972735.618742:0:23795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 21 00000100:00100000:1.0:1790972735.618751:0:23795:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+10:2399:x1877970377671808:12345-192.168.203.39@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790972735.618766:0:23795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790972735.618788:0:23795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a1208f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ec9 expref: 10 pid: 24149 timeout: 773 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.618801:0:23795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a1208f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ec9 expref: 10 pid: 24149 timeout: 773 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.618834:0:23795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7698194/0xd61f4faa13a1208f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.39@tcp remote: 0x197238ab90fb1ec9 expref: 10 pid: 24149 timeout: 773 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.618870:0:23795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972735.618874:0:23795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790972735.618880:0:23795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.618891:0:23795:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.618922:0:23795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790972735.618981:0:23795:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:528aeac5-b99c-4b0d-ae9b-e84937861361+9:2399:x1877970377671808:12345-192.168.203.39@tcp:103:ldlm_bl.0 Request processed in 230us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.618989:0:23795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 21 00010000:00010000:0.0:1790972735.619621:0:24154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790972735.619634:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790972735.684046:0:24962:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:1.0:1790972735.684063:0:24962:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1790972735.684425:0:24154:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1790972735.684431:0:24154:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1790972734 -> 1790972736 00002000:00010000:2.0:1790972735.684434:0:24154:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1790972734 -> 1790972736 00002000:00010000:2.0:1790972735.684436:0:24154:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1790972735.684451:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.684464:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.684547:0:24154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.684556:0:24154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e41fc2c00 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:2.0:1790972735.684561:0:24154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.684570:0:24154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.684588:0:24154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.684596:0:24154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4640b4a/0xd61f4faa13a120ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790972735.684759:0:24154:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+6:2398:x1877970377671680:12345-192.168.203.39@tcp:4:dd.0 Request processed in 69912us (70184us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1790972735.684769:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 0 00000100:00100000:2.0:1790972735.684797:0:24154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 1 00000100:00100000:2.0:1790972735.684806:0:24154:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888d07d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2398:x1877970377671552:12345-192.168.203.39@tcp:4:dd.0 00002000:00010000:2.0:1790972735.684849:0:24154:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 7654321, mtime: 0x6ac01340, atime: 0x6ac0133e, ctime: 0x6ac01340, blocks: 0x1a68 00010000:00010000:2.0:1790972735.684855:0:24154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005507a5d7/0xd61f4faa13a120d5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.684879:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=673s v=(0 0) 00010000:00010000:2.0:1790972735.684883:0:24154:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790972735.684890:0:24154:0:(ldlm_resource.c:1770:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005507a5d7/0xd61f4faa13a120d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790972735.684912:0:24154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005507a5d7/0xd61f4faa13a120d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972735.723713:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.723802:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.723838:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.723864:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377672448 00000100:00100000:1.0:1790972735.723874:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377672448 00000100:00100000:1.0:1790972735.723940:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00100000:1.0:1790972735.723950:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+5:2396:x1877970377672448:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1790972735.724026:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+5:2396:x1877970377672448:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 77us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.724034:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 53 00000100:00080000:1.0:1790972735.724061:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790972735.724095:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.724172:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.724186:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.724201:0:23867:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377672064 00000100:00100000:1.0:1790972735.724204:0:23867:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377672064 00000100:00080000:1.0:1790972735.724215:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1790972735.724233:0:22643:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377672320 00000100:00100000:1.0:1790972735.724236:0:22643:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377672320 00000100:00100000:1.0:1790972735.724252:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:1.0:1790972735.724258:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2396:x1877970377672064:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1790972735.724283:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2396:x1877970377672064:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 24us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.724289:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 54 00000100:00100000:1.0:1790972735.724300:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00100000:1.0:1790972735.724305:0:22643:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+6:2396:x1877970377672320:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1790972735.724327:0:22643:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+6:2396:x1877970377672320:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.724333:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 55 00000100:00080000:1.0:1790972735.724344:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790972735.724377:0:3632:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.39@tcp (source: 12345-192.168.203.39@tcp) 00000100:00100000:1.0:1790972735.724394:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377672192 00000100:00100000:1.0:1790972735.724397:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377672192 00000100:00100000:1.0:1790972735.724421:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377672704 00000100:00100000:1.0:1790972735.724423:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377672704 00000100:00100000:1.0:1790972735.724434:0:24149:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377672576 00000100:00100000:1.0:1790972735.724436:0:24149:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377672576 00000100:00100000:1.0:1790972735.724448:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:1.0:1790972735.724453:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2396:x1877970377672192:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1790972735.724496:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2396:x1877970377672192:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 30us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.724504:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 15 00000100:00100000:1.0:1790972735.724516:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:1.0:1790972735.724522:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+5:2396:x1877970377672704:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1790972735.724543:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+5:2396:x1877970377672704:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.724550:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 16 00000100:00100000:1.0:1790972735.724560:0:24149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00100000:1.0:1790972735.724565:0:24149:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+5:2396:x1877970377672576:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:1.0:1790972735.724588:0:24149:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7e7e985b-53ac-495e-afad-1d490636b4f4+5:2396:x1877970377672576:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 22us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1790972735.724594:0:24149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 17 00000100:00080000:1.0:1790972735.724608:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790972735.724611:0:22638:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790972735.729010:0:22634:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970377671936 00000100:00100000:2.0:1790972735.729026:0:22634:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970377671936 00000100:00100000:2.0:1790972735.729128:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.39@tcp, seq: 166 00000100:00100000:2.0:1790972735.729138:0:22634:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e3a744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+13:2396:x1877970377671936:12345-192.168.203.39@tcp:400:kworker.0 00000100:00100000:2.0:1790972735.729221:0:22634:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e3a744c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:aa856691-2c52-48da-b123-663ad7a17d2e+13:2396:x1877970377671936:12345-192.168.203.39@tcp:400:kworker.0 Request processed in 84us (5516us total) trans 0 rc 0/0 00000100:00100000:2.0:1790972735.729229:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 166 00000001:00080000:3.0:1790972735.736598:0:24962:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00000100:00100000:1.0:1790972735.736715:0:3641:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397688832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790972735.736786:0:3641:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972735.736973:0:22648:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397688832 00000100:00100000:3.0:1790972735.736982:0:22648:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397688832 00000100:00100000:3.0:1790972735.737033:0:22648:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790972735.737042:0:22648:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397688832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1790972735.737075:0:22648:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1790972735.737120:0:22648:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3641:x1877970397688832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972735.737127:0:22648:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790972735.737168:0:3641:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3641:1877970397688832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1790972735.737917:0:3639:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790972735.737929:0:3639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff888d08896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397688960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1790972735.737971:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790972735.738097:0:22647:0:(service.c:2319:ptlrpc_server_handle_req_in()) unwrap req x1877970397688960 00000100:00100000:3.0:1790972735.738102:0:22647:0:(service.c:2389:ptlrpc_server_handle_req_in()) got req x1877970397688960 00000100:00100000:3.0:1790972735.738131:0:22647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1790972735.738138:0:22647:0:(service.c:2575:ptlrpc_server_handle_request()) Handling RPC req@ffff888e16375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397688960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1790972735.738161:0:22647:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1790972735.738205:0:22647:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888e16375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3639:x1877970397688960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790972735.738212:0:22647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790972735.738279:0:3639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff888d08896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3639:1877970397688960:0@lo:41:osp-pre-0-1.0 00002000:00010000:1.0:1790972735.738630:0:24154:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:1.0:1790972735.738648:0:24154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005507a5d7/0xd61f4faa13a120d5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.738708:0:24154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005507a5d7/0xd61f4faa13a120d5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.738718:0:24154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005507a5d7/0xd61f4faa13a120d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.738724:0:24154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff888e41fc2800 already unused, calling callback (ffffffffc0d59ac0) 00010000:00010000:1.0:1790972735.738729:0:24154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005507a5d7/0xd61f4faa13a120d5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.738737:0:24154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005507a5d7/0xd61f4faa13a120d5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.738754:0:24154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005507a5d7/0xd61f4faa13a120d5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790972735.738762:0:24154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005507a5d7/0xd61f4faa13a120d5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790972735.738854:0:24154:0:(service.c:2633:ptlrpc_server_handle_request()) Handled RPC req@ffff888d07d7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:528aeac5-b99c-4b0d-ae9b-e84937861361+5:2398:x1877970377671552:12345-192.168.203.39@tcp:4:dd.0 Request processed in 54047us (124230us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1790972735.738866:0:24154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.39@tcp, seq: 1 00010000:00010000:3.0:1790972736.053201:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790972736.630617:0:23395:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1790972737.085061:0:22631:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790972737.194168:0:25723:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1790972738.101917:0:22630:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13947 lines, 13947 kept, 0 dropped, 0 bad.